Skip to content

Allow automated edge worker maintenance#66310

Merged
jscheffl merged 3 commits intoapache:mainfrom
jscheffl:feature/allow-automated-edge-worker-maintenance
May 4, 2026
Merged

Allow automated edge worker maintenance#66310
jscheffl merged 3 commits intoapache:mainfrom
jscheffl:feature/allow-automated-edge-worker-maintenance

Conversation

@jscheffl
Copy link
Copy Markdown
Contributor

@jscheffl jscheffl commented May 3, 2026

Sometimes edge workers are known not to be healthy and in #65472 we added an interface that edge workers can report their health state to the reporting.

This PR enables the option that workers - if certain level of health exceeded - turn themself into maintenance. And also optionally can turn operational if the condition resolved.

In such case a system information hook most probably is to be deployed and configured to check for a specific condition (e.g. free disk space). Looks like:
image

When all is good back again then it looks like:
image


Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@jscheffl jscheffl requested a review from dheerajturaga as a code owner May 3, 2026 16:39
@boring-cyborg boring-cyborg Bot added area:providers provider:edge Edge Executor / Worker (AIP-69) / edge3 labels May 3, 2026
@jscheffl
Copy link
Copy Markdown
Contributor Author

jscheffl commented May 3, 2026

FYI @AutomationDev85 - would be cool having a review from you as well.

@jscheffl jscheffl force-pushed the feature/allow-automated-edge-worker-maintenance branch from 61a7e68 to c38c484 Compare May 3, 2026 17:26
Copy link
Copy Markdown
Contributor

@AutomationDev85 AutomationDev85 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like this Idea!

@jscheffl jscheffl force-pushed the feature/allow-automated-edge-worker-maintenance branch from 33e261e to 75b0f80 Compare May 4, 2026 16:59
@jscheffl jscheffl merged commit 558765d into apache:main May 4, 2026
91 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:edge Edge Executor / Worker (AIP-69) / edge3

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants