Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Add support for the cuFile Stream API in cuIO #16740

Open
GregoryKimball opened this issue Sep 4, 2024 · 0 comments
Open

[FEA] Add support for the cuFile Stream API in cuIO #16740

GregoryKimball opened this issue Sep 4, 2024 · 0 comments
Labels
cuIO cuIO issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code.

Comments

@GregoryKimball
Copy link
Contributor

Is your feature request related to a problem? Please describe.
cuFile provides both a synchronous API and an asynchronous "stream" API. kvikIO has bindings for the asynchronous API. We should add support for kvikIO's async cuFile backend in libcudf, so that we can test this and make it available to power-users.

Describe the solution you'd like
Somehow add an alternate set of kvikIO binding for device file reads.

Additional context
cuFile synchronous API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-io-api

cuFile async "stream" API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-stream-api

I think the kvikIO API is here: https://docs.rapids.ai/api/kvikio/stable/api/#kvikio.cufile.CuFile.raw_read_async.

@GregoryKimball GregoryKimball added cuIO cuIO issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. labels Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cuIO cuIO issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code.
Projects
None yet
Development

No branches or pull requests

1 participant