Spark35 upgrade#222

Open

BalamuruganDE wants to merge 30 commits into

homeaway:masterfrom

BalamuruganDE:spark35_upgrade

Commits on Sep 11, 2025

Adding default application tag 'datapullemr' when application tags are missing from the input JSON
Balamurugan Kannadasan
committed

Commits on Sep 22, 2025

Merge branch 'homeaway:master' into master
BalamuruganDE
authored

Commits on Oct 7, 2025

Merge branch 'homeaway:master' into master
BalamuruganDE
authored

Commits on Feb 9, 2026

Merge branch 'homeaway:master' into master
BalamuruganDE
authored

Commits on Feb 16, 2026

Addressing "key not found: url" Exception
Balamurugan Kannadasan
committed
Merge branch 'homeaway:master' into master
BalamuruganDE
authored
Revoking URL changes
Balamurugan Kannadasan
committed

Commits on Mar 5, 2026

Merge branch 'homeaway:master' into master
BalamuruganDE
authored
Upgrade DataPull core to Spark 3.5.0, Scala 2.12, Java 11
Balamurugan Kannadasan
committed
Test commit
Balamurugan Kannadasan
committed

Commits on Mar 6, 2026

Updating pom.xml to overcome compilation
Balamurugan Kannadasan
committed
Adding code changes to address runtime issue with EMR 7.12.0
Balamurugan Kannadasan
committed

Commits on Mar 9, 2026

Retaining Single jsonfield column with full document JSON
Balamurugan Kannadasan
committed
Addressing uuidToBinary, Sequencefile issue
Balamurugan Kannadasan
committed
Addressing tmpFileLocation & documentfromjsonfield json response issue
Balamurugan Kannadasan
committed
Updating elasticsearch deps version
Balamurugan Kannadasan
committed

Commits on Mar 10, 2026

Adding more Iceberg features and addressing null subnet edge cases
Balamurugan Kannadasan
committed
Addressing IcebergUtils compilation errors
Balamurugan Kannadasan
committed

Commits on Mar 11, 2026

Fix double SparkContext creation causing YARN Promise crash
Balamurugan Kannadasan
committed
Addressing bson encoder strict validation issue
Balamurugan Kannadasan
committed
Updating elasticsearch-spark-30_2.1 to 8.17.10
Balamurugan Kannadasan
committed
Updating elasticsearch-spark-30_2.1 to 8.17.10
Balamurugan Kannadasan
committed

Commits on Mar 16, 2026

changing greedy (.*) to non-greedy/lazy (.*?)
Balamurugan Kannadasan
committed
Addressing IMDSv2 empty post
Balamurugan Kannadasan
committed

Commits on Mar 18, 2026

Addressing spark 3.5 strict static config validation
Balamurugan Kannadasan
committed
Updating default instance type m7g as part spark 3.5 upgrade
Balamurugan Kannadasan
committed

Commits on Apr 1, 2026

Addressing "key not found: url" Exception
Balamurugan Kannadasan
committed
Dummy commit
Balamurugan Kannadasan
committed
Dummy commit 2
Balamurugan Kannadasan
committed

Commits on Apr 29, 2026

Addressing below issues/bugs
BalamuruganDE
committed