Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extraction and Transformation of Ibtracs #210

Merged
merged 1 commit into from
Mar 20, 2025

Conversation

sudan45
Copy link
Contributor

@sudan45 sudan45 commented Mar 17, 2025

Addresses

This PR doesn't introduce any:

  • temporary files, auto-generated files or secret keys
  • n+1 queries
  • flake8 issues
  • print
  • typos
  • unwanted comments

This PR contains valid:

  • tests
  • permission checks (tests here too)
  • translations

Sorry, something went wrong.

@sudan45 sudan45 force-pushed the feature/ibtracs-extraction branch 2 times, most recently from 0f43aef to 35d0d99 Compare March 19, 2025 09:07
sample.env Outdated
@@ -1,13 +1,23 @@
DJANGO_SECRET_KEY=test
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please undo this change. We no longer need sample.env

@@ -339,7 +342,7 @@
SENTRY_DSN = env("SENTRY_DSN")
SENTRY_ENABLED = False
SENTRY_MONITOR_CELERY_BEAT_TASKS = env("SENTRY_MONITOR_CELERY_BEAT_TASKS")
if SENTRY_DSN:
if SENTRY_DSN is not None:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the different here?

@@ -27,6 +27,7 @@ env:
USGS_DATA_URL: https://usgs.dummy.com
EMDAT_URL: https://emdat.dummy.com

IBTRACS_DATA_URL: https://ibtracs.com
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
IBTRACS_DATA_URL: https://ibtracs.com
IBTRACS_DATA_URL: https://ibtracs.dummy.com


@staticmethod
@app.task
def task(extraction_id):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
def task(extraction_id):
def task(extraction_id: int):


@staticmethod
@app.task
def task(DATA_URL):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
def task(DATA_URL):
def task(url: str):

Copy link
Member

@tnagorra tnagorra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to update the extraction logic.

@tnagorra tnagorra force-pushed the feature/ibtracs-extraction branch 2 times, most recently from 1ec7023 to 3e283ab Compare March 20, 2025 16:49
- Update transformation of ibtracs
- Update env variable in helm chart
- Update source task and collection
- Update geocoder in basehandler
@tnagorra tnagorra force-pushed the feature/ibtracs-extraction branch from 3e283ab to ce47131 Compare March 20, 2025 16:51
@tnagorra tnagorra merged commit fa46712 into develop Mar 20, 2025
2 checks passed
@tnagorra tnagorra deleted the feature/ibtracs-extraction branch March 20, 2025 16:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants