Skip to content

[batch] Add congestion jobs.#5090

Open
jonathanmetzman wants to merge 9 commits intomasterfrom
cong
Open

[batch] Add congestion jobs.#5090
jonathanmetzman wants to merge 9 commits intomasterfrom
cong

Conversation

@jonathanmetzman
Copy link
Collaborator

The idea is if we schedule a bunch of NOOP jobs and we don't see
many in the last hour, that things are congested.
This might not react fast enough to congestion, but can potentially
pause things for long enough to drain the queue.
In the future we should stop hardcoding and infer how many we should
see completed in the last hour.
Other future improvements can be testing congestion by subconfig
so we can tell if some other resource is saturated.

The idea is if we schedule a bunch of NOOP jobs and we don't see
many in the last hour, that things are congested.
This might not react fast enough to congestion, but can potentially
pause things for long enough to drain the queue.
In the future we should stop hardcoding and infer how many we should
see completed in the last hour.
Other future improvements can be testing congestion by subconfig
so we can tell if some other resource is saturated.
@jonathanmetzman
Copy link
Collaborator Author

/gcbrun

@jonathanmetzman
Copy link
Collaborator Author

Done. PTAL again

@jonathanmetzman
Copy link
Collaborator Author

Actually it's not reay yet. Still dealing with the merge conflict

@github-actions
Copy link

This pull request has not had any activity for 60 days and will be automatically closed in two weeks

@github-actions github-actions bot added the stale label Feb 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants