All pull requests

Pull requests

• [SPARK-60857][SQL] Fix DSv2 CREATE/REPLACE TABLE accepting a generation expression whose struct field names differ from the column type

  #60075·dongjoon-hyun opened Nov 4, 2026Member·

  ·

• [WIP][SQL] Fix nested nullability in recursive CTEs

  #60074·n-young opened Nov 4, 2026·

  ·

• [SS] Fix watermark propagation through reused exchanges

  #60073·siying opened Nov 4, 2026Contributor·

  ·

• [SPARK-60856][SQL] Fix DSv2 CHECK constraint failing every write when its condition subscripts a lambda variable

  #60072·dongjoon-hyun opened Nov 4, 2026Member·

  ·
  1

• [SPARK-60855][CORE] Remove the Spark JAR from the Python worker PYTHONPATH

  #60071·gaogaotiantian opened Nov 4, 2026Contributor·

  ·

• [SPARK-60850][SS] Preserve watermark columns when pruning stream-stream joins

  #60068·siying opened Nov 3, 2026Contributor·

  ·

• [SPARK-60851][PYTHON][SS] Fix streaming listener job tags

  #60066·lzhang0616 opened Nov 3, 2026·

  ·

• [SPARK-60848][TESTS] Regenerate benchmark results after bumping the minimum Java to 21

  ai-review-requested
  #60064·dongjoon-hyun opened Nov 3, 2026Member·

  ·
  1

• [SPARK-60323][SQL] Support escape sequences in Variant colon paths

  #60063·bojana-db opened Nov 3, 2026Contributor·

  ·

• [SPARK-60846][CONNECT] Accept Decimal from Spark 4.3.0 clients in Scala UDF payloads

  #60062·dwsmith1983 opened Nov 3, 2026Contributor·

  ·

• [WIP][SQL] Widen nested nullability of recursive CTE self-references

  #60061·stevomitric opened Nov 3, 2026Contributor·

  ·

• [WIP][SQL] Keep the collation of a collated variant_get target type in comparisons

  #60060·stevomitric opened Nov 3, 2026Contributor·

  ·

• [WIP][SQL] Keep the CHAR/VARCHAR metadata of an aliased outer reference

  #60059·stevomitric opened Nov 3, 2026Contributor·

  ·

• [SPARK-60460][SQL][4.1] Fix nested SPJ leaving a one-side shuffle at the old partition count

  #60058·ammarchalifah opened Nov 3, 2026·

  ·
  1

• [SPARK-60844][SQL] Add opt-in RLIKE literal simplification

  #60057·xumingming opened Nov 3, 2026Contributor·

  ·

• [SPARK-60843][SQL] Truncate decimals exactly when casting to INT, SMALLINT and TINYINT

  #60056·dwsmith1983 opened Nov 3, 2026Contributor·

  ·
  2

• [SPARK-60692][SS][SQL] Support lookup-side projections and filters, semi/anti joins and range predicates in external lookup join

  ai-review-requested
  #60055·HeartSaVioR opened Nov 3, 2026Contributor·

  ·
  1

• [SPARK-60841][SQL] Restrict LikeSimplification to binary collations

  #60054·xumingming opened Nov 3, 2026Contributor·

  ·
  1

• [SPARK-60840][SQL] Remove DPP filters on partition keys that a fully pushed DSv2 equality filter already fixes

  ai-review-requested
  #60053·LuciferYang opened Nov 3, 2026Contributor·

  ·

• [SPARK-60832][SQL] Shrink the sparse index array of LongToUnsafeRowMap at optimize time

  ai-review-requested
  #60048·wangyum opened Nov 3, 2026Member·

  ·

• [SPARK-60027][PYTHON] Fix unordered DataFrame equality with floating-point tolerance

  #60047·adiranjan25 opened Nov 3, 2026·

  ·
  1

• [SPARK-60834][INFRA] Run master post-merge builds every ten commits

  ai-review-requested
  #60045·zhengruifeng opened Nov 3, 2026Contributor·

  ·
  10

• [SPARK-60770][SQL][SS] Add AvailableNow coverage for more query features (Part 2)

  #60032·siying opened Nov 2, 2026Contributor·

  ·
  2

• [SPARK-60814][INFRA] Determine revert vs reapply by wrapper parity in merge_spark_pr.py

  ai-review-requested
  #60031·sarutak opened Nov 2, 2026Member·

  ·
  26

• [SPARK-60752][SQL] Share a V2 scan's planned input partitions between the copies of its BatchScanExec

  ai-review-requested
  #60030·peter-toth opened Nov 2, 2026Contributor·

  ·
  25