Skip to content

[LIVY-1024] Upgrade Livy to Python3#485

Merged
gyogal merged 10 commits into
apache:masterfrom
ArnavBalyan:arnavb/python-upgrade
Dec 4, 2025
Merged

[LIVY-1024] Upgrade Livy to Python3#485
gyogal merged 10 commits into
apache:masterfrom
ArnavBalyan:arnavb/python-upgrade

Conversation

@ArnavBalyan

@ArnavBalyan ArnavBalyan commented Sep 28, 2025

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

  • Python2 was deprecated a while back, most systems/environments don't support it anymore
  • Bump Livy to Python3, remove Python2 support since Spark 2 has also now been deprecated
  • Closes LIVY-1024

How was this patch tested?

  • CI / Locally tested the python3 files manully

@ArnavBalyan ArnavBalyan changed the title [LIVY-484] Upgrade to Python3 [LIVY-484] Upgrade Livy to Python3 Sep 28, 2025
@ArnavBalyan

Copy link
Copy Markdown
Member Author

cc @lmccay @gyogal could you please review thanks!

@gyogal

gyogal commented Nov 28, 2025

Copy link
Copy Markdown
Contributor

Thank you, I think your change looks great! There is one more reference to Python 2 that could be changed:
https://github.com/apache/incubator-livy/blob/master/repl/src/main/scala/org/apache/livy/repl/PythonInterpreter.scala#L52
Spark uses "python3" by default:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala#L51

@ArnavBalyan

Copy link
Copy Markdown
Member Author

Thank you, I think your change looks great! There is one more reference to Python 2 that could be changed: https://github.com/apache/incubator-livy/blob/master/repl/src/main/scala/org/apache/livy/repl/PythonInterpreter.scala#L52 Spark uses "python3" by default: https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala#L51

Updated thanks

@gyogal gyogal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks, @ArnavBalyan !

@ArnavBalyan ArnavBalyan changed the title [LIVY-484] Upgrade Livy to Python3 [LIVY-1024] Upgrade Livy to Python3 Dec 4, 2025
@gyogal
gyogal merged commit 5b4e348 into apache:master Dec 4, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants