All pull requests

Pull requests

• [WIP][SDP] Memoize flow reachability queries in the pipelines DataflowGraph

  #59179·david-mollitor-db opened Oct 1, 2026Contributor·

  ·

• [SPARK-59907][SS] Release in-flight buffer when StreamingShuffleWriter.write() fails

  #59177·Jasraj-Dhanoa opened Oct 1, 2026·

  ·

• [SPARK-59913][INFRA] Point PR component-tag guidance in AGENTS.md to the merge_spark_pr.py registry

  #59174·gaogaotiantian opened Sep 30, 2026Contributor·

  ·
  2

• [SPARK-59912][PYTHON][TESTS] Fix flaky WorkerReuseTest and WorkerPoolCrashTest by pinning spark.python.use.daemon

  #59172·gaogaotiantian opened Sep 30, 2026Contributor·

  ·

• [WIP][SPARK-59911][PYTHON] Introduce a pandas eval-type handler base and migrate SQL_SCALAR_PANDAS_UDF

  #59171·Yicong-Huang opened Sep 30, 2026Contributor·

  ·

• [SPARK-59909][PYTHON] Fix PySpark errors raised with undefined error conditions or mismatched message parameters

  #59170·jubins opened Sep 30, 2026Contributor·

  ·
  1

• [SPARK-59906][PYTHON][TESTS] Run relevant tests when JVM-launched Python worker scripts change under smart test selection

  #59169·gaogaotiantian opened Sep 30, 2026Contributor·

  ·

• [SPARK-58601][PYTHON][TEST][FOLLOWUP] Cover the mapInBatch acceptAnyIterable default in mapInArrow/mapInPandas

  #59168·Yicong-Huang opened Sep 30, 2026Contributor·

  ·

• [SPARK-59722][SQL] Enforce CHAR/VARCHAR semantics for JSON map keys

  #59167·srielau opened Sep 30, 2026Contributor·

  ·

• [SPARK-59887][SPARK-59901][SQL] Fix wrong results when a storage-partitioned join pairs a transform of a join-key expression with one of a column

  #59165·peter-toth opened Sep 30, 2026Contributor·

  ·
  28

• [WIP][CORE][SQL] Prototype compact UI storage and metric tracking

  #59164·gengliangwang opened Sep 30, 2026Member·

  ·

• [SPARK-59898][SQL] Compare BinaryType values by content in freqItems

  #59162·david-mollitor-db opened Sep 30, 2026Contributor·

  ·

• [SPARK-59897][SQL] Support filters from both join children in PlanMerger

  #59161·hemanthboyina opened Sep 30, 2026Contributor·

  ·

• [SPARK-59891][SQL] Classify only syntax error codes as syntax errors in Teradata dialect

  #59160·SEPURI-SAI-KRISHNA opened Sep 30, 2026Contributor·

  ·
  3

• [SPARK-59805][SQL] Avoid BigDecimal round trips for wide decimals that fit in a long in UnsafeRow

  #59159·dwsmith1983 opened Sep 30, 2026Contributor·

  ·

• [SPARK-59890][SQL][TESTS] Replace ResolveAsOfJoinSuite with end-to-end ASOF JOIN tests

  #59158·LukaZdravic opened Sep 30, 2026Contributor·

  ·
  1

• [SPARK-59886][UDF][TESTS][FOLLOWUP] Test scalar external UDFs end to end through a direct gRPC worker

  #59155·zozo123 opened Sep 30, 2026Contributor·

  ·
  1

• [SPARK-57468][SQL] Add SparkPlan.convention() API to support different columnar batch types

  #59154·zhztheplayer opened Sep 30, 2026Member·

  ·

• [SPARK-59122][4.3][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller

  #59151·LuciferYang opened Sep 30, 2026Contributor·

  ·
  2

• [SPARK-55569][SQL] Collapse non-matching pivot column values in fast-path firstAgg

  #59149·shrirangmhalgi opened Sep 30, 2026Contributor·

  ·
  1

• [SPARK-59369][SQL] Add integration testing for JDBC syntax error classification

  #59148·Admaing opened Sep 30, 2026·

  ·
  8

• [SPARK-59884][SQL] Mark SparkPlan's columnar execution cache transient

  #59146·sunchao opened Sep 30, 2026Member·

  ·
  36

• [SPARK-59896][SQL] Copy a freqItems value only when storing it in the counter map

  #59145·david-mollitor-db opened Sep 29, 2026Contributor·

  ·
  1

• [SPARK-59877][SS] Fix state store reuse race in Cartesian joins

  #59144·liviazhu opened Sep 29, 2026Contributor·

  ·
  5

• [SPARK-59871][SQL] Balance wide predicate trees in optimizer to avoid stack overflow

  #59143·juliuszsompolski opened Sep 29, 2026Contributor·

  ·
  2