Skip to content

feat: add end-to-end priority queueing - #325

Open
Kevin Cho (chokevin) wants to merge 1 commit into
chokevin-portal-overviewfrom
chokevin-priority-queueing
Open

Kevin Cho (chokevin) wants to merge 1 commit into
chokevin-portal-overviewfrom
chokevin-priority-queueing

Conversation

@chokevin

Copy link
Copy Markdown
Contributor

Summary

  • add TauGrid-managed default and priority tier selection across workload profiles, CLI rendering, and the Python SDK/CLI
  • propagate the selected tier to Kueue Workloads and Job/RayJob pod templates, while rejecting ambiguous exact-class combinations
  • expose resolved Kueue admission priority and Kubernetes pod priority in queue snapshots and the Portal overview
  • order pending workloads by resolved numeric priority and then FIFO, with deterministic constrained-quota coverage
  • add a distinct Active jobs section sourced from actual Job/RayJob runtime status so admission is not confused with execution
  • lock down the portable Kueue ordering/preemption and PriorityClass contract with Helm tests and documentation

This is stack layer 2 above #323 and intentionally targets chokevin-portal-overview.

Validation

  • cd portal && make test && make build && make lint
  • cd portal/frontend && npm test -- --run — 36 tests passed
  • focused core priority tests and go vet
  • focused CLI/profile/Job/RayJob tests, go vet, and make build
  • cd sdk/python/python && python3 -m pytest -q && ruff check . — 109 tests passed
  • helm unittest charts/taugrid — 48 tests passed
  • helm lint charts/taugrid
  • helm template test charts/taugrid --namespace taugrid-system
  • cd site && make check
  • python3 scripts/check-license-headers.py
  • git diff --check

No live cluster was contacted or modified.

AI assistance

GitHub Copilot assisted with implementation, test generation, conflict resolution, and validation. The resulting behavior and changes were reviewed and validated in the commands above.

@feiskyer Pengfei Ni (feiskyer) left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants