Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rayon is underutilizing threads #26

Open
denehoffman opened this issue Dec 4, 2024 · 0 comments
Open

Rayon is underutilizing threads #26

denehoffman opened this issue Dec 4, 2024 · 0 comments
Labels
help wanted Extra attention is needed

Comments

@denehoffman
Copy link
Owner

This is a problem I figured I'd run into. The overhead for creating and moving new threads is greater than the performance gain. I believe this might depend on dataset size, but I think a future version should play around with thread pool settings to optimize this. Here's the current performance vs. number of threads:

lines

The uptick at the end is probably just because this benchmark isn't isolated, and whatever processes are currently running on my computer are interfering with the cores that laddu wants to use.

@denehoffman denehoffman added the help wanted Extra attention is needed label Dec 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant