Skip to content

(feat/conc) Move fully to a concurrency limit system#1045

Merged
nickscamara merged 12 commits intomainfrom
nsc/concurrency-prod
Jan 30, 2025
Merged

(feat/conc) Move fully to a concurrency limit system#1045
nickscamara merged 12 commits intomainfrom
nsc/concurrency-prod

Conversation

@nickscamara
Copy link
Member

No description provided.

@nickscamara nickscamara requested a review from mogery January 6, 2025 15:54
Copy link
Member

@mogery mogery left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rest looks good. I'll Redis-ify it later today.

@mogery
Copy link
Member

mogery commented Jan 8, 2025

@nickscamara moved to redis, pls check again

@nickscamara
Copy link
Member Author

Might be wise to keep the db check after redis in case the redis restarts(?)

@nickscamara nickscamara merged commit 7c0b3ad into main Jan 30, 2025
1 check passed
timoa pushed a commit to timoa/firecrawl that referenced this pull request Feb 2, 2025
* Nick: conc limits init

* Nick: test suite plans

* fix(email_notification): move expiry check to redis

* fix(email_notification): add db check in case redis resets

* Update rate-limiter.ts

* Update queue-jobs.ts

* Create concurrency-limit.test.ts

* Update concurrency-limit.test.ts

* Create queue-concurrency-integration.test.ts

* Update queue-concurrency-integration.test.ts

---------

Co-authored-by: Móricz Gergő <[email protected]>
@mogery mogery deleted the nsc/concurrency-prod branch February 17, 2025 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants