Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Workflows] [Feature] Feature to limit the maximum number of workflows running. #24029

Closed
fishbone opened this issue Apr 19, 2022 · 2 comments
Closed

[Workflows] [Feature] Feature to limit the maximum number of workflows running. #24029

fishbone opened this issue Apr 19, 2022 · 2 comments
Assignees
@suquark
Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks workflow
Milestone
Workflows after-a...

Comments

@fishbone
Copy link
Contributor

Description

To better support #21161

One feature we need is to ensure workflow is able to limit the number of active workflows running.

We'll need APIs like this:

workflow.init(max_concurrent_jobs=N, max_queueing_jobs=M)

max_concurrent_jobs means for a given time, how many workflow jobs can run. A job will be queued if the number of running jobs reaches the limit.
max_queueing_jobs means the maximum number of jobs that can be queued. An exception will be thrown if the number of jobs queued reaches the limit.

Use case

One use case is here: #21161
@fishbone fishbone added enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks workflow labels Apr 19, 2022
@fishbone fishbone added this to the Workflows Pre-Beta milestone Apr 19, 2022
@fishbone
Copy link
Contributor Author

@ericl could you help review the proposed API there?

@clarkzinzow clarkzinzow changed the title [workflow] Feature to limit the maximum number of workflows running. [Workflows] [Feature] Feature to limit the maximum number of workflows running. Apr 20, 2022
@suquark suquark mentioned this issue May 11, 2022
Merged
15 tasks
@suquark
Copy link
Member

suquark commented Jul 9, 2022

Close this issue with #24697

@suquark suquark closed this as completed Jul 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@suquark suquark

Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks workflow
Projects
None yet
Milestone
Workflows after-alpha
Development

No branches or pull requests
2 participants
@suquark @fishbone