-
Notifications
You must be signed in to change notification settings - Fork 171
Update the documentation to use parquet output #2607
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
erikvansebille
merged 83 commits into
Parcels-code:main
from
erikvansebille:update_parquet_docs
May 4, 2026
Merged
Changes from all commits
Commits
Show all changes
83 commits
Select commit
Hold shift + click to select a range
ffe0ebf
Update .gitignore
VeckoTheGecko 9ebb653
Disable zarr writing
VeckoTheGecko 0218c28
Fix parquet writing
VeckoTheGecko 4e7de3e
Remove test_vriable_write_double
VeckoTheGecko bc653f1
Fix all "uses_old_zarr" tests
VeckoTheGecko 5daec3b
Remove test_variable_write_double
VeckoTheGecko 2a07ced
Fixing tests
VeckoTheGecko b8c5477
More test fixing
VeckoTheGecko 2d438c5
Fix last tests
VeckoTheGecko 32a82fa
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 19fbd8d
Remove old fixtures
VeckoTheGecko e74672f
Fix pre-commit errors
VeckoTheGecko db9f983
Cleanup
VeckoTheGecko ac2a830
Add pandas and pyarrow as explicit dependencies
VeckoTheGecko de464e5
Add assert_cftime_like_particlefile
VeckoTheGecko 57ccf6f
MAINT: Cleanup create_particle_data
VeckoTheGecko b2bde50
Add cftime metadata serialization
VeckoTheGecko 55493a9
Add np.timedelta64 support
VeckoTheGecko bab4d5d
Fix assert_cftime_like_particlefile
VeckoTheGecko b28665c
Move imports
VeckoTheGecko 7184e1f
Fixing tests
VeckoTheGecko e7e37ef
Fix test_time_is_age test
VeckoTheGecko 54c829a
Refactor assert_cftime_like_particlefile
VeckoTheGecko 8626d48
Self-review feedback
VeckoTheGecko 3693329
Fix test_particle_schema
VeckoTheGecko 81f127b
Make read_particlefile public
VeckoTheGecko 9fcb5bf
Add docstring to read_particlefile
VeckoTheGecko 41ed3d8
Updarting Argo tutorial to use parquet
erikvansebille b64a00e
Updating tutorial_nemo to use parquet output
erikvansebille 5e0fc7f
Update tutorial_diffusion to use parquet
erikvansebille 511ce10
Update tutorial_output to use parquet
erikvansebille 04d8676
Review feedback
VeckoTheGecko 6695187
Update migration guide
VeckoTheGecko b4e2214
Remove obs_written
VeckoTheGecko a5bdd31
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 663f80c
Update migration guide
VeckoTheGecko 5be22aa
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 002b8f2
Revert from extra_metadata to metadata
VeckoTheGecko 3c52647
Fix test_pfile_array_remove_particles
VeckoTheGecko 39ab122
Merge branch 'main' into push-zlxyoyvlpoqm
VeckoTheGecko ae375b3
Fix numpy warning
VeckoTheGecko ebf2b54
Merge branch 'push-zlxyoyvlpoqm' of https://github.com/VeckoTheGecko/…
erikvansebille 8379a88
Merge branch 'pr/2583' into update_parquet_docs
erikvansebille c10e741
Using polars in tutorial_output
erikvansebille b986c81
Update explanation_concepts.md
erikvansebille 4d5d670
update tutorial_croco to use parquet
erikvansebille e005595
using polars for read_particlefile
erikvansebille f738ca7
Update tutorial_quickstart to use parquet
erikvansebille ea9fe51
Update tutorial_output to use polars
erikvansebille 4a222e1
Merge branch 'main' into update_parquet_docs
erikvansebille 8b380a0
Update v4-migration.md
erikvansebille b049a73
Fix using polars in tutorial_output
erikvansebille 59ed170
Fixing read_parquet to use polars
erikvansebille 3f326ce
Update tutorial_delaystart to use parquet
erikvansebille 1a48b44
Update tutorial_dt_integrators to use parquet
erikvansebille 9e3b88a
Fixing parcels.read_particlefile for timedelta time
erikvansebille 9084910
Update tutorial_interaction to use parquet
erikvansebille 3ad3f10
Update tutorial_manipulating_field_data to use parquet
erikvansebille daad8c9
Update tutorial_mitgcm to use parquet
erikvansebille f811b8d
Updsate tutorial_nestedgrids to use parquet
erikvansebille 4dd08b9
Update tutorial_sampling to use parquet (and remove to_write="once" s…
erikvansebille b06a051
Removing old attributes from particlefile.repr
erikvansebille aa9fbd1
Using more intuitive variable names for polars subsetting
erikvansebille b57e78f
Fixing repr of particleset
erikvansebille 9aa1459
Update tutorial_Argofloats.ipynb
erikvansebille d521ad3
Update tutorial_quickstart to use parquet
erikvansebille 3d0c55d
Update tutorial_croco_3D.ipynb
erikvansebille 580d5fb
Using polars in tutorial_diffusion
erikvansebille 4571bca
Use polars in tutorial_nemo
erikvansebille 3d29c72
Use parquet in explanation_kernelloop
erikvansebille 45c9cf0
Update policies.md
erikvansebille d47202b
Fixing unit tests to use polars in parcels.read_particlefile
erikvansebille 31dabc0
Merge branch 'main' into update_parquet_docs
erikvansebille 31a49e8
Merge branch 'main' into update_parquet_docs
VeckoTheGecko 3b2a166
Merge branch 'main' into update_parquet_docs
VeckoTheGecko 1b35bf9
Doc fix: docs/user_guide/examples/tutorial_dt_integrators.ipynb
VeckoTheGecko afb4ce8
Fixing plotting in tutorial_nestedgrids
erikvansebille 12fb3b7
Fixing colour range of nemo 3D plot
erikvansebille 7551160
Using start location for last plot in quickstart
erikvansebille ff12ea0
Fixing assert statement in tutorial_quickstart
erikvansebille 0241c28
Adding comment on cftime
erikvansebille 7cfad91
Update tutorial_quickstart.md
erikvansebille 5fb45b3
Update docs/getting_started/tutorial_quickstart.md
erikvansebille File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Some comments aren't visible on the classic Files Changed page.
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've gone through this - really nice update! I think its quite clear