Morph MORPH
SIGN IN SIGN UP
apache / spark UNCLAIMED

Apache Spark - A unified analytics engine for large-scale data processing

43074 0 198 Scala

COMMITS

/ python/pyspark/sql/tests/test_python_datasource.py
master
March 24, 2026
T
[SPARK-56186][PYTHON] Retire pypy
Tian Gao committed
d51b39b
Y
[SPARK-56165][PYTHON][TESTS] Use temporary directory instead of saveAsTable in test_data_source_segfault
Yicong Huang committed
3a9a5b7
March 20, 2026
T
[SPARK-55799][PYTHON][TESTS][FOLLOW-UP] Disable some expensive tests for data source simple worker
Tian Gao committed
a3c65da
March 19, 2026
T
[SPARK-56018][PYTHON] Use ruff as formatter
Tian Gao committed
eac3fe3
T
[SPARK-56062][PYTHON] Isolate memory_profiler to improve import time
Tian Gao committed
811c7b7
March 16, 2026
Y
[SPARK-55986][PYTHON] Upgrade black to 26.3.1
yangjie01 committed
cbcee8c
March 11, 2026
T
[SPARK-55851][PYTHON] Clarify types of datasource partition and read
Tian Gao committed
1b63af8
March 3, 2026
T
[SPARK-55799][PYTHON][TESTS] Add datasource tests with simple worker
Tian Gao committed
50f9412
March 2, 2026
Y
[SPARK-55583][PYTHON] Validate Arrow schema types in Python data source
Yicong-Huang committed
b38e8ea
February 18, 2026
T
[SPARK-55474][PYTHON][TESTS] Remove test files from ignore list of ruff
Tian Gao committed
f74d3fb
February 2, 2026
T
[SPARK-55161][PYTHON] Support profilers on python data source
Tian Gao committed
22094fe
January 7, 2026
T
[SPARK-54906][PYTHON][TESTS] Unify test entry for all pyspark tests
Tian Gao committed
c27ede3
December 1, 2025
T
[SPARK-54544][PYTHON] Enable flake8 F811 check
Tian Gao committed
b4c84c9
November 12, 2025
T
[SPARK-54323][PYTHON] Change the way to access logs to TVF instead of system view
Takuya Ueshin committed
fb8dbd7
November 10, 2025
K
[SPARK-54065][PYTHON][TESTS][FOLLOWUP] Remove unused import module from `test_python_datasource.py`
Kousuke Saruta committed
8cc76fe
D
[SPARK-54065][PYTHON][TESTS] Enable `test_in_memory_data_source` in Python 3.14
Dongjoon Hyun committed
79d0c42
October 31, 2025
T
[SPARK-53978][PYTHON] Support logging in driver-side workers
Takuya Ueshin committed
6e41ac5
October 29, 2025
D
[SPARK-54066][PYTHON][TESTS] Skip `test_in_memory_data_source` in Python 3.14
Dongjoon Hyun committed
3b10407
October 20, 2025
R
[SPARK-53938][PYTHON][CONNECT] Fix decimal rescaling in LocalDataToArrowConversion
Ruifeng Zheng committed
5edebd2
June 5, 2025
H
[SPARK-50815][PYTHON] Fix Variant Local Data to Arrow Conversion
Harsh Motwani committed
6f5fb36
March 26, 2025
H
[SPARK-51574][PYTHON] Filter serialization for Python Data Source filter pushdown
Haoyu Weng committed
49295b3
March 20, 2025
H
[SPARK-51271][PYTHON] Add filter pushdown API to Python Data Sources
Haoyu Weng committed
b08cb22
January 29, 2025
T
[SPARK-50909][PYTHON][FOLLOWUP] Disable segfault tests in pypy
Takuya Ueshin committed
8dbf1dd
January 23, 2025
T
[SPARK-50909][PYTHON] Setup faulthandler in PythonPlannerRunners
Takuya Ueshin committed
917a9a1
January 17, 2025
R
[SPARK-50867][PYTHON][TESTS] Move `search_jar` and `SPARK_HOME` to `sqlutils.py`
Ruifeng Zheng committed
3a12038
December 2, 2024
A
[SPARK-50471][PYTHON] Support Arrow-based Python Data Source Writer
Allison Wang committed
31abad9
September 4, 2024
L
[SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance
Luca Canali committed
cc3df38
June 21, 2024
A
[SPARK-48653][PYTHON] Fix invalid Python data source error class references
allisonwang-db committed
b0b02b2
March 26, 2024
H
[SPARK-47367][PYTHON][CONNECT][TESTS][FOLLOW-UP] Recover the test case for the number of partitions
Hyukjin Kwon committed
ded8cdf
A
[SPARK-47367][PYTHON][CONNECT] Support Python data sources with Spark Connect
allisonwang-db committed
a127df4
February 28, 2024
H
[SPARK-47199][PYTHON][TESTS] Add prefix into TemporaryDirectory to avoid flakiness
Hyukjin Kwon committed
6eed08c
January 18, 2024
H
[SPARK-46751][PYTHON][TESTS] Skip test_datasource if PyArrow is not installed
Hyukjin Kwon committed
751a81b
January 5, 2024
A
[SPARK-46568][PYTHON] Make Python data source options a case-insensitive dictionary
allisonwang-db committed
a98c885
January 3, 2024
A
[SPARK-46565][PYTHON] Refine error classes and error messages for Python data sources
allisonwang-db committed
bdb6172
January 2, 2024
A
[SPARK-46540][PYTHON] Respect column names when Python data source read function outputs named Row objects
allisonwang-db committed
48a09c4
December 29, 2023
A
[SPARK-45914][PYTHON] Support commit and abort API for Python data source write
allisonwang-db committed
f99b86a
December 22, 2023
A
[SPARK-45525][SQL][PYTHON] Support for Python data source write using DSv2
allisonwang-db committed
4fcd5bf
December 12, 2023
A
[SPARK-46253][PYTHON] Plan Python data source read using MapInArrow
allisonwang-db committed
01d61a5
November 30, 2023
A
[SPARK-45940][PYTHON] Add InputPartition to DataSourceReader interface
allisonwang-db committed
2fad7b7
November 23, 2023
A
[SPARK-45600][PYTHON] Make Python data source registration session level
allisonwang-db committed
c8ad616
November 20, 2023
A
[SPARK-45927][PYTHON] Update path handling for Python data source
allisonwang-db committed
25ee62e
November 8, 2023
A
[SPARK-45639][SQL][PYTHON] Support loading Python data sources in DataFrameReader
allisonwang-db committed
9d93b71
November 1, 2023
A
[SPARK-45654][PYTHON] Add Python data source write API
allisonwang-db committed
14d347c
October 31, 2023
A
[SPARK-45713][PYTHON] Support registering Python data sources
allisonwang-db committed
6cb0cd5
October 24, 2023
A
[SPARK-45524][PYTHON][SQL] Initial support for Python data source read API
allisonwang-db committed
7ef96ee