Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grouped jobs firing multiple times #46

Open
hardcodet opened this issue May 4, 2023 · 1 comment
Open

Grouped jobs firing multiple times #46

hardcodet opened this issue May 4, 2023 · 1 comment

Comments

@hardcodet
Copy link

Noticed the following issue here in my logs:

  1. I'm scheduling a grouped job (concurrency: 1) for execution
  2. BullMQ triggers the execution (with quite a delay, even though it was scheduled for immediate execution, and there weren't too many jobs. This may be a red herring though).
  3. about 30 seconds later, the job is triggered again

image

  • I looked for similar log entires, and it appears this happens from time to time, and then in clusters.
  • May be a load issue.
  • No services were restarted during those times
  • we're currently running version 5.1.10

image

Any idea why this is happening?

@manast
Copy link
Contributor

manast commented May 4, 2023

As you mentioned it would be quite useful to understand why the job is delayed. Could there be an issue with the workers? are they really online?
A job processed twice is often produced by a job that has been stalled as if the worker has lost connectivity or hung for too long, which makes the job get stalled, which will result in a reprocessing of the same job. Check the job details to see if it has been attempted several times, that would be an indication of this behaviour.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants