Morph MORPH
SIGN IN SIGN UP
apache / spark UNCLAIMED

Apache Spark - A unified analytics engine for large-scale data processing

0 0 324 Scala

COMMITS

/ python/pyspark/sql/worker/plan_data_source_read.py
master
March 27, 2026
T
[SPARK-55827][PYTHON] Fix type hint for datasource workers
Tian Gao committed
592e896
March 19, 2026
T
[SPARK-56018][PYTHON] Use ruff as formatter
Tian Gao committed
eac3fe3
March 17, 2026
T
[SPARK-55851][PYTHON][FOLLOW-UP] Deal with NotImplementedError for partitions()
Tian Gao committed
ed21be7
March 11, 2026
T
[SPARK-55851][PYTHON] Clarify types of datasource partition and read
Tian Gao committed
1b63af8
March 2, 2026
Y
[SPARK-55583][PYTHON] Validate Arrow schema types in Python data source
Yicong-Huang committed
b38e8ea
T
[SPARK-55663][PYTHON] Unify __module__ for data source functions
Tian Gao committed
1cc5916
February 26, 2026
T
[SPARK-55665][PYTHON] Unify how workers establish connection with the executor
Tian Gao committed
191801b
January 20, 2026
T
[SPARK-55053][PYTHON] Refactor data source/udtf analysis workers so they have a unified entry
Tian Gao committed
9f0b238
January 6, 2026
R
[SPARK-54903][PYTHON] Make to_arrow_schema/to_arrow_type able to set timezone
Ruifeng Zheng committed
7b62f5f
November 18, 2025
A
[SPARK-54349][PYTHON] Refactor code a bit to simplify faulthandler integration extension
antban committed
6227fba
October 31, 2025
T
[SPARK-53978][PYTHON] Support logging in driver-side workers
Takuya Ueshin committed
6e41ac5
October 20, 2025
X
[SPARK-53696][PYTHON][CONNECT][SQL] Default to bytes for BinaryType in PySpark
xianzhe-databricks committed
57b4cd2
June 30, 2025
T
[SPARK-52599][PYTHON] Support periodical traceback dump in Driver side workers
Takuya Ueshin committed
0c8d18d
April 15, 2025
H
[SPARK-51688][PYTHON] Use Unix Domain Socket between Python and JVM communication
Hyukjin Kwon committed
d3b6dd1
March 27, 2025
H
[SPARK-51575][PYTHON] Combine Python Data Source pushdown & plan read workers
Haoyu Weng committed
46bd9cc
March 20, 2025
H
[SPARK-51271][PYTHON] Add filter pushdown API to Python Data Sources
Haoyu Weng committed
b08cb22
February 27, 2025
H
[SPARK-51206][PYTHON][CONNECT] Move Arrow conversion helpers out of Spark Connect
Haoyu Weng committed
727167a
January 23, 2025
T
[SPARK-50909][PYTHON] Setup faulthandler in PythonPlannerRunners
Takuya Ueshin committed
917a9a1
September 5, 2024
H
[SPARK-48493][PYTHON][FOLLOW-UP] Fix documentation for Arrow batch support in Python Data Source
Hyukjin Kwon committed
f7292cb
September 4, 2024
L
[SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance
Luca Canali committed
cc3df38
July 24, 2024
H
[SPARK-48961][PYTHON] Make the parameter naming of `PySparkException` consistent with JVM
Haejoon Lee committed
090ad9f
June 21, 2024
A
[SPARK-48653][PYTHON] Fix invalid Python data source error class references
allisonwang-db committed
b0b02b2
April 30, 2024
C
[SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source
Chaoqin Li committed
c8c2492
April 25, 2024
H
Revert "[SPARK-45302][PYTHON] Remove PID communication between Pythonworkers when no demon is used"
Hyukjin Kwon committed
c6aaa18
April 4, 2024
H
[SPARK-47683][PYTHON][BUILD] Decouple PySpark core API to pyspark.core package
Hyukjin Kwon committed
678aeb7
March 27, 2024
C
[SPARK-47107][SS][PYTHON] Implement partition reader for python streaming data source
Chaoqin Li committed
e3e7135
January 3, 2024
A
[SPARK-46565][PYTHON] Refine error classes and error messages for Python data sources
allisonwang-db committed
bdb6172
January 2, 2024
A
[SPARK-46540][PYTHON] Respect column names when Python data source read function outputs named Row objects
allisonwang-db committed
48a09c4
December 12, 2023
A
[SPARK-46253][PYTHON] Plan Python data source read using MapInArrow
allisonwang-db committed
01d61a5
November 30, 2023
A
[SPARK-45940][PYTHON] Add InputPartition to DataSourceReader interface
allisonwang-db committed
2fad7b7
October 24, 2023
A
[SPARK-45524][PYTHON][SQL] Initial support for Python data source read API
allisonwang-db committed
7ef96ee