Skip to content

Commit

Permalink
Document how to reingest deltares
Browse files Browse the repository at this point in the history
  • Loading branch information
ghidalgo3 committed Dec 5, 2024
1 parent b06aa36 commit 4ebf06f
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 3 deletions.
18 changes: 17 additions & 1 deletion datasets/deltaresfloods/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,19 @@
# deltaresfloods PC Tasks

PCTasks code for ingesting deltaresfloods data into the Planetary Computer.
PCTasks code for ingesting deltaresfloods data into the Planetary Computer.
These STAC items JSONs are stored as blobs in the `deltaresfloodssa` storage account under the `floods-stac` container.
You can mount them locally and make modifications before re-ingesting them into the STAC database.

## Item Updates
After fixing items in the `deltaresfloodssa/floods-stac` container, you may run to reingest them:

```bash
pctasks dataset process-items xarray-access-fix \
-a since "2024-11-17T00:00:00Z" \
--dataset datasets/deltaresfloods/dataset.yaml \
--is-update-workflow --upsert --submit
```

Set since to a date strictly before you modified the STAC items in storage.
For example, if you modified items on December 4, set the since to be any date before December 4.
`since` must be a full ISO8061 datetime.
4 changes: 2 additions & 2 deletions datasets/deltaresfloods/dataset.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
id: deltaresfloods
image: pccomponentstest.azurecr.io/pctasks-basic:2022.6.16.2
image: pccomponents.azurecr.io/pctasks-task-base:latest
target_environment: staging

collections:
Expand All @@ -16,4 +16,4 @@ collections:
extensions:
- ".json"
chunk_storage:
uri: blob://deltaresfloodssa/floods-etl-data/chunks
uri: blob://deltaresfloodssa/floods-etl-data/chunks

0 comments on commit 4ebf06f

Please sign in to comment.