[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement request: support for priorities #50

Open
tomaszklim opened this issue Aug 21, 2023 · 2 comments
Open

Enhancement request: support for priorities #50

tomaszklim opened this issue Aug 21, 2023 · 2 comments

Comments

@tomaszklim
Copy link
tomaszklim commented Aug 21, 2023

Task spooler would be a great replacement for "real" queue servers, but it misses a few capabilities. One of them is support for priorities.

Minimal form: normal and high priority (or normal and low).

Ideally, 3 priorities (low, normal, high), or even more.

@tomaszklim tomaszklim changed the title Enhancement request: bigger queue size Enhancement request: support for priorities Aug 21, 2023
@justanhduc
Copy link
Owner

hi @tomaszklim. It can be done by manually swapping the jobs for now. Is there any other benefit for doing this?

@tomaszklim
Copy link
Author

To swap jobs, you need to:

  • know the details
  • work at rather small scale

Imagine that you have millions or even billions of items to process - eg. imagine that you're processing Twitter streams and each tweet is 1 job. Is would be optimal to keep such queue as busy as possible. But sometimes (and only sometimes) you have some tasks, that individually are more important and urgent - so you want to process them quicker. As since the quantity of processed tasks is so big. that it is impossible or impractical to work with them on per-task basis.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants