Skip to content

trxcllnt/kvikio

 
 

Repository files navigation

KvikIO: High Performance File IO

Summary

KvikIO is a Python and C++ library for high performance file IO. It provides C++ and Python bindings to cuFile, which enables GPUDirect Storage (GDS). KvikIO also works efficiently when GDS isn't available and can read/write both host and device data seamlessly. The C++ library is header-only making it easy to include in existing projects.

Features

  • Object oriented API of cuFile with C++/Python exception handling.
  • A Python Zarr backend for reading and writing GPU data to file seamlessly.
  • Concurrent reads and writes using an internal thread pool.
  • Non-blocking API.
  • Handle both host and device IO seamlessly.
  • Provides Python bindings to nvCOMP.

Documentation

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Jupyter Notebook 45.7%
  • Python 22.1%
  • C++ 17.3%
  • Cython 9.4%
  • CMake 2.8%
  • Shell 2.3%
  • Other 0.4%