SIGN IN SIGN UP
apache / spark UNCLAIMED

Apache Spark - A unified analytics engine for large-scale data processing

0 0 1098 Scala

[SPARK-51178][CONNECT][PYTHON] Raise proper PySpark error instead of `SparkConnectGrpcException`

### What changes were proposed in this pull request?

This PR propose to raise proper PySpark error instead of `SparkConnectGrpcException`.

This PR also introduces new PySpark error `PickleException` to cover the errors that represents an exception which is failed while pickling from server side

### Why are the changes needed?

To raise proper exception instead of `SparkConnectGrpcException`

### Does this PR introduce _any_ user-facing change?

No API changes, but the user-facing error improvement.

### How was this patch tested?

Updated the existing UT

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #49953 from itholic/SPARK-51178.

Authored-by: Haejoon Lee <haejoon.lee@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
H
Haejoon Lee committed
4134e9f208bb53db72f0c7398473c6af63da3838
Parent: ead7d58
Committed by Hyukjin Kwon <gurwls223@apache.org> on 2/18/2025, 11:35:29 PM