Dependency clean up

README.md

@@ -2,13 +2,19 @@
 
 ## Summary
 
-This provides C++ and Python bindings to cuFile, which enables GPUDirect Storage (or GDS).
+This provides C++ and Python bindings to cuFile, which enables GPUDirect Storage (GDS).
+KvikIO also works efficiently when GDS isn't available and can read/write both host and
+device data seamlessly. KvikIO
 
 ### Features
 
-* Object Oriented API
-* Exception handling
-* Zarr reader
+* Object Oriented API.
+* Exception handling.
+* Concurrent reads and writes using an internal thread pool.
+* Non-blocking API.
+* Python Zarr reader.
+* Handle both host and device IO seamlessly.
+* Provides Python bindings to [nvCOMP](https://github.com/NVIDIA/nvcomp).
 
 ## Requirements
 
@@ -17,19 +23,22 @@ installed (v11.4+) and a working compiler toolchain (C++17 and cmake).
 
 ### C++
 
-The C++ bindings are header-only and depends on CUDA Driver and Runtime API.
-In order to build and run the example code, CMake is required.
+The C++ bindings are header-only and depends on the CUDA Driver API.
+In order to build and run the example code, CMake and the CUDA Runtime
+API is required.
 
 ### Python
 
-The Python packages depends on the following packages:
+The Python package depends on the following packages:
 
-* Cython
-* Pip
-* Setuptools
+* cython
+* pip
+* setuptools
+* scikit-build
 
-For testing:
+For nvCOMP, benchmarks, examples, and tests:
 * pytest
+* numpy
 * cupy
 
 ## Install

conda/recipes/kvikio/meta.yaml

@@ -42,14 +42,16 @@ requirements:
     - libkvikio {{ version }}
   run:
     - python
-    - cupy
+    - numpy >=1.20
+    - cupy >=9.5.0
     - zarr
     - {{ pin_compatible('cudatoolkit', max_pin='x', min_pin='x') }}
 
 test:
+  requires:
+    - pytest
   imports:
     - kvikio
-    - kvikio.cufile
 
 about:
   home: http://rapids.ai/

python/setup.cfg

@@ -46,6 +46,9 @@ skip=
 
 [options]
 packages = find:
-install_requires =
-    numpy
-python_requires = >=3.8,<3.10
+python_requires = >=3.8
+
+[options.extras_require]
+nvcomp =
+    numpy >=1.20
+    cupy >=9.5.0

python/tests/test_benchmarks.py

@@ -10,6 +10,7 @@
 
 benchmarks_path = Path(os.path.realpath(__file__)).parent / ".." / "benchmarks"
 
+pytest.importorskip("cupy")
 pytest.importorskip("dask")
 
 

python/tests/test_examples.py

@@ -5,10 +5,14 @@
 from importlib import import_module
 from pathlib import Path
 
+import pytest
+
 examples_path = Path(os.path.realpath(__file__)).parent / ".." / "examples"
 
 
 def test_hello_world(tmp_path, monkeypatch):
     """Test examples/hello_world.py"""
+    pytest.importorskip("cupy")  # `examples/hello_world.py` requires CuPy
+
     monkeypatch.syspath_prepend(str(examples_path))
     import_module("hello_world").main(tmp_path / "test-file")

python/tests/test_nvcomp.py

@@ -1,10 +1,10 @@
 # Copyright (c) 2021-2022, NVIDIA CORPORATION. All rights reserved.
 # See file LICENSE for terms.
 
-import cupy
-import numpy as np
 import pytest
 
+np = pytest.importorskip("numpy")
+cupy = pytest.importorskip("cupy")
 cudf = pytest.importorskip("cudf")
 kvikio = pytest.importorskip("kvikio")
 libnvcomp = pytest.importorskip("kvikio.nvcomp")