Add new processing and transformation commands for geospatial data#181
Open
Conversation
- Implemented `process geotiff-to-cog` and `transform geotiff-to-cog` commands for converting GeoTIFF files to Cloud Optimized GeoTIFFs (COGs) with options for reprojection, compression, and overview generation. - Added `process shapefile-to-geojson` and `transform shapefile-to-geojson` commands to convert shapefiles to GeoJSON, including options for handling local time fields. - Introduced `process csv-to-geojson` and `transform csv-to-geojson` commands for converting CSV files with latitude/longitude into GeoJSON points, with support for local timestamps. - Created unit tests for new geospatial transformation functions, ensuring correct handling of time zones and output formats. - Added tests for overlay rendering in visualizations, verifying the correct assignment of features by time and rendering of overlays on maps. Signed-off-by: Eric Hackathorn <Eric.J.Hackathorn@noaa.gov>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces new geospatial and raster transformation utilities, improves CLI input handling for byte reading, and updates documentation to reflect new features. The main changes are the addition of modules for converting shapefiles and CSVs to GeoJSON, transforming GeoTIFFs to Cloud Optimized GeoTIFFs (COGs), and refactoring how input bytes are read to support subsetting and remote sources.
Geospatial and Raster Transformation Utilities
src/zyra/transform/geospatial.pywith functions to convert shapefiles and CSV point tables to GeoJSON, including timestamp normalization and timezone handling. Also includes CLI-compatible write helpers.src/zyra/transform/raster.pywith a function to convert GeoTIFFs to Cloud Optimized GeoTIFFs, supporting reprojection, tiling, overviews, and compression options.CLI Input Handling Improvements
read_all_bytesinsrc/zyra/utils/cli_helpers.pyto support reading from local files, HTTP(S) URLs, and other schemes, improving robustness and flexibility for CLI commands._read_input_bytesinsrc/zyra/processing/__init__.pyto support.idx-based GRIB subsetting for HTTP and S3 sources, used in several CLI commands for more efficient data access. [1] [2] [3] [4]Documentation Updates
src/zyra/transform/README.mdto document new commands:shapefile-to-geojsonandcsv-to-geojson, with example usage demonstrating time normalization and timezone options. [1] [2]