Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Prevent multiple task queuing for same concurrency key #1437

Unanswered
gautamsi asked this question in Q&A
Discussion options

I am trying to evaluate his for pg-boss replacement, have a question.

pg-boss allows to prevent duplicate task while in queue, that means if something is already processed already it can be queued, otherwise it will just be discarded if the item is already in queue. Idempotency is not helpful as it prevents running that task forever in the same task scope

I like to be

  • queue task like scrape a website
  • prevent same website being queued while previous one has not finished
  • able to queue this again (if needed) only if previous run has already completed.
  • able to scrape other website in parallel

is this possible?

You must be logged in to vote

Replies: 1 comment

Comment options

I think this is called a "dropping queue": https://effect.website/docs/concurrency/queue/#dropping-queue

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants

AltStyle によって変換されたページ (->オリジナル) /