Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using max_concurrency or AsyncActor? #76

Open
chiragjn opened this issue Oct 21, 2024 · 0 comments
Open

Using max_concurrency or AsyncActor? #76

chiragjn opened this issue Oct 21, 2024 · 0 comments

Comments

@chiragjn
Copy link

I was reading through the code and trying out a large number of workers with a tiny model. Often I found my cpu and memory getting bottlenecked because of the large number of actors launching Python workers.

Wondering what was the motivation to not use threaded or async actors to achieve higher concurrency?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant