Skip to content

Use GitHub authentication and retries for metadata requests#79

Merged
rapids-bot[bot] merged 4 commits into
rapidsai:mainfrom
bdice:github-api-auth-retries
Jul 7, 2026
Merged

Use GitHub authentication and retries for metadata requests#79
rapids-bot[bot] merged 4 commits into
rapidsai:mainfrom
bdice:github-api-auth-retries

Conversation

@bdice

@bdice bdice commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

This updates remote metadata fetching to use the GitHub Contents API with GH_TOKEN or GITHUB_TOKEN when available, while retaining the raw URL for unauthenticated requests. It adds bounded retries for rate limits and transient HTTP or transport errors, honoring GitHub’s Retry-After header when provided. This addresses the cuDF style-check failure where an unauthenticated metadata request returned HTTP 429. It depends on rapidsai/shared-workflows#589 to expose ${{ github.token }} as GH_TOKEN to style-check jobs.

@bdice bdice marked this pull request as ready for review July 6, 2026 23:01
@bdice bdice requested a review from a team as a code owner July 6, 2026 23:01
@bdice bdice requested a review from gforsyth July 6, 2026 23:01
Comment thread tests/test_remote.py Outdated
rapids-bot Bot pushed a commit to rapidsai/shared-workflows that referenced this pull request Jul 7, 2026
This exposes the GitHub Actions token to `ci/check_style.sh` as `GH_TOKEN`. The style-check job already receives a repository-scoped token with `contents: read`, but the failing step did not have it in its environment, so `rapids-metadata` made an unauthenticated request and hit HTTP 429. Passing the token follows GitHub's supported authentication pattern and enables the companion rapidsai/rapids-metadata#79 change to make authenticated requests with retries. rapidsai/rapids-metadata#79 depends on this PR.

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Tom Augspurger (https://github.com/TomAugspurger)
  - Gil Forsyth (https://github.com/gforsyth)

URL: #589
@bdice

bdice commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

/merge

@bdice

bdice commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@rapids-bot rapids-bot Bot merged commit 5ef7d95 into rapidsai:main Jul 7, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants