[SPARK-46080][PYTHON] Upgrade Cloudpickle to 3.0.0

### What changes were proposed in this pull request? This PR proposes to upgrade Cloudpickle from 2.2.1 to 3.0.0. ### Why are the changes needed? It includes official support of Python 3.12 (cloudpipe/cloudpickle#517) ### Does this PR introduce _any_ user-facing change? It includes official support of Python 3.12 (cloudpipe/cloudpickle#517) ### How was this patch tested? Relies on cloudpickle's unittests. Existing test cases should pass too. Closes #43989 from HyukjinKwon/SPARK-46080. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
apache · Nov 24, 2023 · d3d35ab · d3d35ab
1 parent 4be5e21
commit d3d35ab
Show file tree

Hide file tree

Showing 3 changed files with 988 additions and 1,270 deletions.
diff --git a/python/pyspark/cloudpickle/__init__.py b/python/pyspark/cloudpickle/__init__.py
@@ -1,8 +1,18 @@
+from pyspark.cloudpickle import cloudpickle  # noqa
 from pyspark.cloudpickle.cloudpickle import *  # noqa
-from pyspark.cloudpickle.cloudpickle_fast import CloudPickler, dumps, dump  # noqa
 
-# Conform to the convention used by python serialization libraries, which
-# expose their Pickler subclass at top-level under the  "Pickler" name.
-Pickler = CloudPickler
+__doc__ = cloudpickle.__doc__
 
-__version__ = '2.2.1'
+__version__ = "3.0.0"
+
+__all__ = [  # noqa
+    "__version__",
+    "Pickler",
+    "CloudPickler",
+    "dumps",
+    "loads",
+    "dump",
+    "load",
+    "register_pickle_by_value",
+    "unregister_pickle_by_value",
+]