Morph MORPH
SIGN IN SIGN UP
apache / spark UNCLAIMED

Apache Spark - A unified analytics engine for large-scale data processing

0 0 331 Scala

COMMITS

/ python/pyspark/sql/datasource.py
master
March 27, 2026
T
[SPARK-55827][PYTHON] Fix type hint for datasource workers
Tian Gao committed
592e896
March 11, 2026
T
[SPARK-55851][PYTHON] Clarify types of datasource partition and read
Tian Gao committed
1b63af8
February 7, 2026
J
[SPARK-55304][SS][PYTHON] Introduce support of Admission Control and Trigger.AvailableNow in Python data source - streaming reader
Jungtaek Lim committed
cbcc7f8
August 19, 2025
A
[SPARK-53030][PYTHON] Support Arrow writer for streaming Python data sources
Allison Wang committed
9920b22
July 8, 2025
H
Revert "[SPARK-52698][PYTHON] Improve type hints for datasource module"
Hyukjin Kwon committed
00cf5da
July 7, 2025
A
[SPARK-52698][PYTHON] Improve type hints for datasource module
Allison Wang committed
a9b8e37
May 6, 2025
A
[SPARK-51989][PYTHON] Add missing Filter subclasses to __all__ list in datasource
Allison Wang committed
633419a
April 28, 2025
A
[SPARK-51939][PYTHON][DOCS] Refine Python data source docstring by adding arrow batch examples
Allison Wang committed
c9433e2
March 26, 2025
H
[SPARK-51574][PYTHON] Filter serialization for Python Data Source filter pushdown
Haoyu Weng committed
49295b3
March 20, 2025
H
[SPARK-51271][PYTHON] Add filter pushdown API to Python Data Sources
Haoyu Weng committed
b08cb22
December 27, 2024
H
[SPARK-50685][PYTHON] Improve Py4J performance by leveraging getattr
Hyukjin Kwon committed
2d320aa
December 2, 2024
A
[SPARK-50471][PYTHON] Support Arrow-based Python Data Source Writer
Allison Wang committed
31abad9
September 5, 2024
H
[SPARK-48493][PYTHON][FOLLOW-UP] Fix documentation for Arrow batch support in Python Data Source
Hyukjin Kwon committed
f7292cb
September 4, 2024
L
[SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance
Luca Canali committed
cc3df38
July 24, 2024
H
[SPARK-48961][PYTHON] Make the parameter naming of `PySparkException` consistent with JVM
Haejoon Lee committed
090ad9f
June 19, 2024
A
[SPARK-48646][PYTHON] Refine Python data source API docstring and type hints
allisonwang-db committed
47ffe40
June 7, 2024
C
[MINOR][PYTHON] add export class and fix doc typo for python streaming data source
Chaoqin Li committed
cf3051b
April 30, 2024
C
[SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source
Chaoqin Li committed
c8c2492
March 27, 2024
C
[SPARK-47273][SS][PYTHON] implement Python data stream writer interface
Chaoqin Li committed
5ac3918
March 18, 2024
H
[SPARK-47436][PYTHON][DOCS] Fix docstring links and type hints in Python Data Source
Hyukjin Kwon committed
3f171ce
March 12, 2024
C
[SPARK-46962][SS][PYTHON] Add interface for python streaming data source API and implement python worker to run python streaming data source
Chaoqin Li committed
f53dc08
January 15, 2024
H
[SPARK-46720][SQL][PYTHON] Refactor Python Data Source to align with other DSv2 built-in Data Sources
Hyukjin Kwon committed
f3ffd3c
January 5, 2024
A
[SPARK-46568][PYTHON] Make Python data source options a case-insensitive dictionary
allisonwang-db committed
a98c885
December 7, 2023
A
[SPARK-46290][PYTHON] Change saveMode to a boolean flag for DataSourceWriter
allisonwang-db committed
9da1e4c
December 4, 2023
H
[SPARK-46231][PYTHON] Migrate all remaining `NotImplementedError` & `TypeError` into PySpark error framework
Haejoon Lee committed
9666bf3
November 30, 2023
A
[SPARK-45940][PYTHON] Add InputPartition to DataSourceReader interface
allisonwang-db committed
2fad7b7
November 27, 2023
H
[MINOR][PYTHON][DOCS] Remove since decorator usages in pyspark.sql
Hyukjin Kwon committed
685f536
November 20, 2023
A
[SPARK-45927][PYTHON] Update path handling for Python data source
allisonwang-db committed
25ee62e
November 1, 2023
A
[SPARK-45654][PYTHON] Add Python data source write API
allisonwang-db committed
14d347c
October 31, 2023
A
[SPARK-45713][PYTHON] Support registering Python data sources
allisonwang-db committed
6cb0cd5
October 24, 2023
A
[SPARK-45524][PYTHON][SQL] Initial support for Python data source read API
allisonwang-db committed
7ef96ee