feat: update rust edition to 2024

[killzoner]

Which issue does this PR close?

Closes #1271

Revival of #1290
I added pyballista migration too compared to the previous PR

Rationale for this change

Update Rust edition. Now possible since upstream datafusion 51 is targeting a recent enough rust MSRV

What changes are included in this PR?

• update Rust edition
• cargo fix --edition
• cargo fmt
• cargo clippy --fix
• upgrade cargo resolver to v3 (https://doc.rust-lang.org/edition-guide/rust-2024/cargo-resolver.html)

Are there any user-facing changes?

No

[killzoner]

I noticed that pyballista is still tracking datafusion 49, not sure this is normal and might be a blocker according to #1290 (comment)

Fixed msrv check which was actually wrong - my bad ! - (pyballista MSRV break was not reported) and added it to the check in CI

[milenkovicm]

what if we do not change anything in python directory and leave it as it was? keep msrv and dependencies as they were?

[killzoner]

Fine by me

[milenkovicm]

i think other changes are ok, just revert changes to python please

[killzoner]

i think other changes are ok, just revert changes to python please

This should be good now. Added the cargo resolver upgrade since the previous push

[milenkovicm]

Thanks @killzoner

[killzoner]

Thank you for the quick feedbacks!

[milenkovicm]

there are two fresh new issues if you're interested @killzoner

[killzoner]

there are two fresh new issues if you're interested @killzoner

Sure, happy to take on these