MORPH
SIGN IN SIGN UP
apache / spark UNCLAIMED

Apache Spark - A unified analytics engine for large-scale data processing

43055 0 91 Scala

COMMITS

/ python/pyspark/shell.py
master
March 19, 2026
T
[SPARK-56018][PYTHON] Use ruff as formatter
Tian Gao committed
eac3fe3
March 16, 2026
Y
[SPARK-55986][PYTHON] Upgrade black to 26.3.1
yangjie01 committed
cbcee8c
February 17, 2025
T
[SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default
Takuya Ueshin committed
f798e7a
October 21, 2024
G
[SPARK-50036][CORE][PYTHON] Include SPARK_LOG_SCHEMA in the context of REPL shell
Gengliang Wang committed
f86df1e
April 4, 2024
M
[SPARK-47081][CONNECT] Support Query Execution Progress
Martin Grund committed
f6999df
H
[SPARK-47683][PYTHON][BUILD] Decouple PySpark core API to pyspark.core package
Hyukjin Kwon committed
678aeb7
May 18, 2023
H
[SPARK-43509][PYTHON][CONNECT][FOLLOW-UP] Set SPARK_CONNECT_MODE_ENABLED when running pyspark shell with remote is local
Hyukjin Kwon committed
32bdf8a
March 8, 2023
H
[SPARK-42266][PYTHON] Remove the parent directory in shell.py execution when IPython is used
Hyukjin Kwon committed
8e83ab7
January 19, 2023
N
[SPARK-42106][PYTHON] Hide parameters when printing remote URL in REPL
Niranjan Jayakar committed
498b3ec
December 21, 2022
H
[SPARK-41528][CONNECT] Merge namespace of Spark Connect and PySpark API
Hyukjin Kwon committed
764edaf
March 16, 2022
Z
[SPARK-38424][PYTHON] Warn unused casts and ignores
zero323 committed
f84018a
February 15, 2022
H
[SPARK-38121][PYTHON][SQL] Use SparkSession instead of SQLContext inside PySpark
Hyukjin Kwon committed
88696eb
February 5, 2022
Z
[SPARK-38073][PYTHON] Update atexit function to avoid issues with late binding
zero323 committed
3e0d489
November 10, 2021
Z
[SPARK-37022][PYTHON] Use black as a formatter for PySpark
zero323 committed
2fe9af8
November 10, 2020
N
[SPARK-33363] Add prompt information related to the current task when pyspark/sparkR starts
neko committed
4360c6f
October 7, 2020
Z
[SPARK-33002][PYTHON] Remove non-API annotations
zero323 committed
72da6f8
July 14, 2020
H
[SPARK-32138] Drop Python 2.7, 3.4 and 3.5
HyukjinKwon committed
4ad9bfd
September 13, 2018
S
[SPARK-25238][PYTHON] lint-python: Fix W605 warnings for pycodestyle 2.4
Sean Owen committed
08c76b5
June 5, 2018
M
[SPARK-16451][REPL] Fail shell if SparkSession fails to start.
Marcelo Vanzin committed
b3417b7
April 12, 2017
J
[SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell
Jeff Zhang committed
99a9473
July 14, 2016
D
[SPARK-16536][SQL][PYSPARK][MINOR] Expose `sql` in PySpark Shell
Dongjoon Hyun committed
9c53057
May 20, 2016
B
[SPARK-15456][PYSPARK] Fixed PySpark shell context initialization when HiveConf not present
Bryan Cutler committed
021c197
A
[SPARK-15417][SQL][PYTHON] PySpark shell always uses in-memory catalog
Andrew Or committed
c32b1b1
May 12, 2016
S
[SPARK-15072][SQL][PYSPARK] FollowUp: Remove SparkSession.withHiveSupport in PySpark
Sandeep Singh committed
db573fc
April 28, 2016
A
[SPARK-14945][PYTHON] SparkSession Python API
Andrew Or committed
89addd4
January 26, 2016
J
[SPARK-12993][PYSPARK] Remove usage of ADD_FILES in pyspark
Jeff Zhang committed
19fdb21
January 13, 2016
E
[SPARK-12268][PYSPARK] Make pyspark shell pythonstartup work under python3
Erik Selin committed
e4e0b3f
July 24, 2015
C
[SPARK-9270] [PYSPARK] allow --name option in pyspark
Cheolsoo Park committed
9a11396
April 16, 2015
D
[SPARK-4897] [PySpark] Python 3 support
Davies Liu committed
04e44b3
April 8, 2015
D
[SPARK-6781] [SQL] use sqlContext in python shell
Davies Liu committed
6ada4f6
February 17, 2015
D
[SPARK-5872] [SQL] create a sqlCtx in pyspark shell
Davies Liu committed
4d4cc76
A
[SPARK-3340] Deprecate ADD_JARS and ADD_FILES
azagrebin committed
1668765
September 6, 2014
G
[SPARK-3273][SPARK-3301]We should read the version information from the same place
GuoQiang Li committed
21a1e1b
September 4, 2014
M
[SPARK-2435] Add shutdown hook to pyspark
Matthew Farrellee committed
7c6e71f
July 22, 2014
N
[SPARK-2470] PEP8 fixes to PySpark
Nicholas Chammas committed
5d16d5b
July 16, 2014
K
follow pep8 None should be compared using is or is not
Ken Takagiwa committed
563acf5
May 17, 2014
A
[SPARK-1808] Route bin/pyspark through Spark submit
Andrew Or committed
4b8ec6f
April 18, 2014
R
Fixed broken pyspark shell.
Reynold Xin committed
81a152c
April 17, 2014
A
[python alternative] pyspark require Python2, failing if system default is Py3 from shell.py
AbhishekKr committed
bb76eae
April 11, 2014
I
Set spark.executor.uri from environment variable (needed by Mesos)
Ivan Wick committed
5cd11d5
April 7, 2014
A
SPARK-1099: Introduce local[*] mode to infer number of cores
Aaron Davidson committed
0307db0
February 9, 2014
M
Merge pull request #542 from markhamstra/versionBump. Closes #542.
Mark Hamstra committed
c2341c9
January 2, 2014
P
pyspark -> bin/pyspark
Prashant Sharma committed
a3f90a2
December 25, 2013
A
Typo: avaiable -> available
Andrew Ash committed
3665c72
September 24, 2013
P
Update build version in master
Patrick Wendell committed
6079721
September 7, 2013
A
Export StorageLevel and refactor
Aaron Davidson committed
c1cc8c4
A
Remove reflection, hard-code StorageLevels
Aaron Davidson committed
8001687
September 6, 2013
A
SPARK-660: Add StorageLevel support in Python
Aaron Davidson committed
a63d4c7
September 1, 2013
M
Add banner to PySpark and make wordcount output nicer
Matei Zaharia committed
bbaa9d7
August 13, 2013
M
Merge pull request #813 from AndreSchumacher/add_files_pyspark
Matei Zaharia committed
d3525ba