[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Job Parallelism using Run with Overrides #4908

Closed
AriBeck52 opened this issue Dec 31, 2023 · 2 comments
Closed

Feature Request: Job Parallelism using Run with Overrides #4908

AriBeck52 opened this issue Dec 31, 2023 · 2 comments

Comments

@AriBeck52
Copy link
AriBeck52 commented Dec 31, 2023

Is your feature request related to a problem? Please describe.
The overrides ability gives us flexibility to change the container args and the task count on the fly when executing a job but if the number of tasks in that execution is less than the configured parallelism then the job configuration must be updated with a lower parallelism and it defeats the purpose of having one time executions with different amounts of arguments/tasks. We need the parallelism configured because an API we use has a limit on the amount of concurrent requests and we can't just set parallelism to 0.

Describe the solution you'd like
A simple solution would be to allow us to also override the parallelism while overriding containerArgs and taskCount using the execute job with overrides feature.

Describe alternatives you've considered
It could also be possible to implement a dynamic parallelism based on the number of tasks. If the task count is less than the configured parallelism then set the parallelism as the task count.

Additional context
Screenshot 2023-12-31 at 19 58 08
Screenshot 2023-12-31 at 19 59 55

@sofisl sofisl added type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. and removed type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. labels Jan 2, 2024
@sofisl
Copy link
Contributor
sofisl commented Jan 2, 2024

Thanks for the FR! I've submitted it directly to the API team here: https://issuetracker.google.com/issues/318426818

@sofisl sofisl closed this as completed Jan 2, 2024
@AriBeck52
Copy link
Author

@sofisl Thanks for the quick response! I see that the issue you opened is under Cloud Tasks and it should be under Cloud Run... Thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants