Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Global thread pool in benchmarks #16801

Open
vuule opened this issue Sep 11, 2024 · 1 comment
Open

[FEA] Global thread pool in benchmarks #16801

vuule opened this issue Sep 11, 2024 · 1 comment
Labels
cuIO cuIO issue feature request New feature or request Performance Performance related issue tests Unit testing for project

Comments

@vuule
Copy link
Contributor

vuule commented Sep 11, 2024

libcudf currently creates a new thread pool in each multi-threaded benchmark.

This makes reading multithreaded benchmarks very difficult, as the number of unique threads is huge.

Proposed solution:
Files with multithreaded benchmarks should declare a single global pool that's reused in all benchmarks.

@vuule vuule added cuIO cuIO issue feature request New feature or request Performance Performance related issue tests Unit testing for project labels Sep 11, 2024
@vuule vuule changed the title [FEA] Global thread pool [FEA] Global thread pool in benchmarks Nov 5, 2024
@vuule
Copy link
Contributor Author

vuule commented Nov 5, 2024

reduced the scope to benchmarks since we don't want to invest further in the internal cuFile integration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cuIO cuIO issue feature request New feature or request Performance Performance related issue tests Unit testing for project
Projects
Status: In Progress
Development

No branches or pull requests

1 participant