Fix CometShuffleManager hang by deferring SparkEnv access

cfe9b8e

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Sign in for the full log view

Validate Github Workflows on: pull_request

validate

Spark SQL Tests on: pull_request

spark-sql-catalyst/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_core-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_core-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_core-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_hive-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_hive-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-sql_hive-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-catalyst/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_core-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_core-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_core-3/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_hive-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_hive-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-sql_hive-3/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-catalyst/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_core-1/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_core-2/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_core-3/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_hive-1/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_hive-2/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-sql_hive-3/ubuntu-24.04/spark-4.0.1/java-17

spark-sql-native-comet-catalyst/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_core-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_core-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_core-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_hive-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_hive-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-sql_hive-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-native-comet-catalyst/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_core-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_core-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_core-3/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_hive-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_hive-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-native-comet-sql_hive-3/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-catalyst/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_core-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_core-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_core-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_hive-1/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_hive-2/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-sql_hive-3/ubuntu-24.04/spark-3.4.3/java-11

spark-sql-iceberg-compat-catalyst/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_core-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_core-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_core-3/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_hive-1/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_hive-2/ubuntu-24.04/spark-3.5.7/java-11

spark-sql-iceberg-compat-sql_hive-3/ubuntu-24.04/spark-3.5.7/java-11

merge-fallback-logs

Run Miri Safety Checks on: pull_request

Miri

PR Build (Linux) on: pull_request

ubuntu-latest/java 11-rust

ubuntu-latest/java 17-rust

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [fuzz]

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [shuffle]

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [parquet]

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [exec]

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [expressions]

ubuntu-latest/Spark 3.4, JDK 11, Scala 2.12 [sql]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [fuzz]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [shuffle]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [parquet]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [exec]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [expressions]

ubuntu-latest/Spark 3.5.5, JDK 17, Scala 2.13 [sql]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [fuzz]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [shuffle]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [parquet]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [exec]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [expressions]

ubuntu-latest/Spark 3.5.6, JDK 17, Scala 2.13 [sql]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [fuzz]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [shuffle]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [parquet]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [exec]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [expressions]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_datafusion [sql]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [fuzz]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [shuffle]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [parquet]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [exec]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [expressions]

ubuntu-latest/Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat [sql]

ubuntu-latest/Spark 4.0, JDK 17 [fuzz]

ubuntu-latest/Spark 4.0, JDK 17 [shuffle]

ubuntu-latest/Spark 4.0, JDK 17 [parquet]

ubuntu-latest/Spark 4.0, JDK 17 [exec]

ubuntu-latest/Spark 4.0, JDK 17 [expressions]

ubuntu-latest/Spark 4.0, JDK 17 [sql]

Check PR Title on: pull_request 2

check-pr-title

Iceberg Spark SQL Tests on: pull_request

iceberg-spark/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

iceberg-spark-extensions/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

iceberg-spark-runtime/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

iceberg-spark-rust/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

iceberg-spark-extensions-rust/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

iceberg-spark-runtime-rust/${{ matrix.os }}/iceberg-${{ matrix.iceberg-version.full }}/spark-${{ matrix.spark-version.full }}/scala-${{ matrix.scala-version }}/java-${{ matrix.java-version }}

PR Build (macOS) on: pull_request 18

macos-14/Spark 3.4, JDK 11, Scala 2.12 [fuzz]

macos-14/Spark 3.4, JDK 11, Scala 2.12 [shuffle]

macos-14/Spark 3.4, JDK 11, Scala 2.12 [parquet]

macos-14/Spark 3.4, JDK 11, Scala 2.12 [exec]

macos-14/Spark 3.4, JDK 11, Scala 2.12 [expressions]

macos-14/Spark 3.4, JDK 11, Scala 2.12 [sql]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [fuzz]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [shuffle]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [parquet]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [exec]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [expressions]

macos-14/Spark 3.5, JDK 17, Scala 2.13 [sql]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [fuzz]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [shuffle]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [parquet]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [exec]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [expressions]

macos-14/Spark 4.0, JDK 17, Scala 2.13 [sql]

TPC-H Correctness on: pull_request

Build native and prepare data

Run TPCHQuerySuite

Check that all test suites are added to PR workflows on: pull_request

check-missing-suites

TPC-DS Correctness on: pull_request

Build native and prepare data

Run TPCDSQuerySuite (sort_merge)

Run TPCDSQuerySuite (broadcast)

Run TPCDSQuerySuite (hash)

Check that all test suites are added to PR workflows on: pull_request

check-missing-suites

Check PR Title on: pull_request 1

check-pr-title

Check that all test suites are added to PR workflows on: pull_request

check-missing-suites

Check PR Title on: pull_request

check-pr-title

The logs for this run have expired and are no longer available.

Loading

Re-running jobs...