Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Mar 27, 2026

• [SPARK-56244][PYTHON] Refine benchmark class layout in bench_eval_type.py

  Show description for 80d9d47
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  80d9d47

  Copy full SHA for 80d9d47

• [SPARK-55827][PYTHON] Fix type hint for datasource workers

  Show description for 592e896
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  592e896

  Copy full SHA for 592e896

• [SPARK-56123][PYTHON] Refactor SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF

  Show description for bf02188
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  bf02188

  Copy full SHA for bf02188

• [SPARK-56247][PYTHON] Fix the fall back behavior and type hint of inheritable_thread_target

  Show description for 3bff8ca
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  3bff8ca

  Copy full SHA for 3bff8ca

• [SPARK-56242][PYTHON][TESTS] Add a test to ensure no 3rd party libraries are imported for "import pyspark"

  Show description for 52506bf
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  52506bf

  Copy full SHA for 52506bf

• [SPARK-54944][PYTHON][TEST] Add tests for pa.Array.to_pandas with default arguments

  Show description for d7d3ec5
  zhengruifeng

  committed
  d7d3ec5

  Copy full SHA for d7d3ec5

• [SPARK-54804][CONNECT] Reduce conf RPCs SparkSession.createDataset(..)

  Show description for 1e831b6
  hvanhovell

  committed
  1e831b6

  Copy full SHA for 1e831b6

Commits on Mar 26, 2026

• [SPARK-56245][PS] Fix DataFrame.eval inplace assignment on pandas 3

  Show description for a059820
  

  ueshin

  authored and

  HyukjinKwon

  committed
  a059820

  Copy full SHA for a059820

• [SPARK-56221][SQL][PYTHON] Feature parity between spark.catalog.* vs DDL commands

  Show description for 91d62ce
  HyukjinKwon

  committed
  91d62ce

  Copy full SHA for 91d62ce

• [SPARK-55630][SS] Skip updating matched flag for non-outer side in stream-stream join v4

  Show description for 5d6eb71
  HeartSaVioR

  committed
  5d6eb71

  Copy full SHA for 5d6eb71

• [SPARK-56239][UI] Fix SQL tab DataTables: API default limit, date format, and appId resolution

  Show description for 659a32f
  yaooqinn

  committed
  659a32f

  Copy full SHA for 659a32f

• [SPARK-56236][TESTS] Fix npm vulnerabilities related to `picomatch`

  Show description for 5ccc45e
  LuciferYang

  committed
  5ccc45e

  Copy full SHA for 5ccc45e

• [SPARK-56225][SQL] Improve View WITH SCHEMA EVOLUTION error message

  Show description for c72f33e
  

  szehon-ho

  authored and

  cloud-fan

  committed
  c72f33e

  Copy full SHA for c72f33e

• [SPARK-56206][SQL] Fix case-insensitive duplicate CTE name detection

  Show description for 042440d
  

  ilicmarkodb

  authored and

  cloud-fan

  committed
  042440d

  Copy full SHA for 042440d

• [SPARK-56034][SQL] Push down Join through Union when the right side is broadcastable

  Show description for 015b344
  LuciferYang

  committed
  015b344

  Copy full SHA for 015b344

• [SPARK-56219][PS] Align groupby idxmax and idxmin skipna=False behavior with pandas 2/3

  Show description for 932f9f7
  

  ueshin

  authored and

  HyukjinKwon

  committed
  932f9f7

  Copy full SHA for 932f9f7

• [SPARK-56067][PYTHON] Lazy import psutil to improve import speed

  Show description for 6494991
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  6494991

  Copy full SHA for 6494991

• [SPARK-55950][PYTHON][CONNECT] Add PySpark support for CDC changes() API

  Show description for 91e21ee
  

  gengliangwang

  authored and

  zhengruifeng

  committed
  91e21ee

  Copy full SHA for 91e21ee

• [SPARK-56066][PYTHON] Lazy import numpy to improve import speed

  Show description for 533670b
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  533670b

  Copy full SHA for 533670b

• [SPARK-56085][PYTHON][TEST] Add ASV micro-benchmarks for SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF

  Show description for cc85ba1
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  cc85ba1

  Copy full SHA for cc85ba1

• [SPARK-56217][PYTHON] Fix bucketBy exceptions in connect

  Show description for 183086f
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  183086f

  Copy full SHA for 183086f

• [SPARK-56226][PS][CONNECT] Catch analysis errors before `InternalFrame.__init__` in `.loc`

  Show description for 1d30a64
  

  ueshin

  authored and

  zhengruifeng

  committed
  1d30a64

  Copy full SHA for 1d30a64

• [SPARK-56224][PYTHON] Polish type annotations for accumulators.py

  Show description for 6e3ea1c
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  6e3ea1c

  Copy full SHA for 6e3ea1c

• [SPARK-56166][PYTHON] Use ArrowBatchTransformer.enforce_schema to replace column-wise type coercion logic

  Show description for 5c83086
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  5c83086

  Copy full SHA for 5c83086

• [SPARK-55579][PYTHON] Rename PySpark error classes to be eval-type-agnostic

  Show description for 6fb96bc
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  6fb96bc

  Copy full SHA for 6fb96bc

• [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3

  Show description for 5adaeee
  zhengruifeng

  committed
  5adaeee

  Copy full SHA for 5adaeee

• [SPARK-56214][BUILD] Upgrade `Netty` to 4.2.12.Final

  Show description for f76497a
  dongjoon-hyun

  committed
  f76497a

  Copy full SHA for f76497a

• [SPARK-54878][SQL] Add sortKeys option to to_json function

  Show description for f1034c6
  

  xiaoxuandev

  authored and

  HyukjinKwon

  committed
  f1034c6

  Copy full SHA for f1034c6

Commits on Mar 25, 2026

• [SPARK-56209][BUILD] Upgrade `vertx` to 4.5.26

  Show description for 91f89b5
  dongjoon-hyun

  committed
  91f89b5

  Copy full SHA for 91f89b5

• [SPARK-54808] Qualified session view

  Show description for 4c981ae
  

  2 peopleauthored and

  gengliangwang

  committed
  4c981ae

  Copy full SHA for 4c981ae

• [SPARK-56032][SQL][FOLLOW-UP] Fix comments in FilterExec CSE

  Show description for 489370b
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  489370b

  Copy full SHA for 489370b

• [SPARK-56205][SS] Validate base state store checkpoint ID before committing microbatch

  Show description for a17e434
  

  ericm-db

  authored and

  anishshri-db

  committed
  a17e434

  Copy full SHA for a17e434

• [SPARK-55448][CONNECT] Fix query events loss when session closes during query execution

  Show description for 2facd67
  

  biruktesf-db

  authored and

  hvanhovell

  committed
  2facd67

  Copy full SHA for 2facd67

• [SPARK-56203][SQL] Fix race condition in `SortExec.rowSorter`

  Show description for 1e52a02
  

  peter-toth

  authored and

  dongjoon-hyun

  committed
  1e52a02

  Copy full SHA for 1e52a02

• [SPARK-33902][SQL] Support CREATE TABLE LIKE for V2

  Show description for eec506e
  

  viirya

  authored and

  gengliangwang

  committed
  eec506e

  Copy full SHA for eec506e

Pagination

Previous

Next