Skip to content

Commit

Permalink
Add Python 3.11. (#635)
Browse files Browse the repository at this point in the history
Adds support for Python 3.11.

xref: rapidsai/build-planning#3

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Ray Douglass (https://github.com/raydouglass)

URL: #635
  • Loading branch information
bdice authored Mar 5, 2024
1 parent 9732fb4 commit 4b52bab
Show file tree
Hide file tree
Showing 7 changed files with 15 additions and 14 deletions.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# syntax=docker/dockerfile:1

ARG CUDA_VER=12.0.1
ARG PYTHON_VER=3.10
ARG PYTHON_VER=3.11
ARG LINUX_VER=ubuntu22.04

ARG RAPIDS_VER=24.04
Expand Down
8 changes: 4 additions & 4 deletions dockerhub-readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ There are two types:

The tag naming scheme for RAPIDS images incorporates key platform details into the tag as shown below:
```
24.04-cuda11.8-py3.10
24.04-cuda11.8-py3.11
^ ^ ^
| | Python version
| |
Expand All @@ -48,7 +48,7 @@ The tag naming scheme for RAPIDS images incorporates key platform details into t
RAPIDS version
```

**Note: Nightly builds of the images have the RAPIDS version appended with an `a` (ie `24.04a-cuda11.8-py3.10`)**
**Note: Nightly builds of the images have the RAPIDS version appended with an `a` (ie `24.04a-cuda11.8-py3.11`)**

## Usage

Expand Down Expand Up @@ -81,7 +81,7 @@ $ docker run \
-e EXTRA_CONDA_PACKAGES="jq" \
-e EXTRA_PIP_PACKAGES="beautifulsoup4" \
-p 8888:8888 \
rapidsai/notebooks:24.04-cuda11.8-py3.10
rapidsai/notebooks:24.04-cuda11.8-py3.11
```

### Bind Mounts
Expand All @@ -106,7 +106,7 @@ $ docker run \
--gpus all \
-shm-size=1g --ulimit memlock=-1 --ulimit stack=67108864 \
-v $(pwd)/environment.yml:/home/rapids/environment.yml \
rapidsai/base:24.04-cuda11.8-py3.10
rapidsai/base:24.04-cuda11.8-py3.11
```

### Use JupyterLab to Explore the Notebooks
Expand Down
6 changes: 3 additions & 3 deletions matrix-test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,11 +3,11 @@
pull-request:
- { CUDA_VER: '11.8', ARCH: 'amd64', PYTHON_VER: '3.9', GPU: 'v100', DRIVER: 'earliest' }
- { CUDA_VER: '12.0', ARCH: 'amd64', PYTHON_VER: '3.10', GPU: 'v100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'arm64', PYTHON_VER: '3.10', GPU: 'a100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'arm64', PYTHON_VER: '3.11', GPU: 'a100', DRIVER: 'latest' }
branch:
- { CUDA_VER: '11.8', ARCH: 'amd64', PYTHON_VER: '3.9', GPU: 'v100', DRIVER: 'earliest' }
- { CUDA_VER: '11.8', ARCH: 'amd64', PYTHON_VER: '3.9', GPU: 'v100', DRIVER: 'latest' }
- { CUDA_VER: '12.0', ARCH: 'amd64', PYTHON_VER: '3.10', GPU: 'v100', DRIVER: 'latest' }
- { CUDA_VER: '12.0', ARCH: 'arm64', PYTHON_VER: '3.10', GPU: 'a100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'amd64', PYTHON_VER: '3.10', GPU: 'v100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'arm64', PYTHON_VER: '3.10', GPU: 'a100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'amd64', PYTHON_VER: '3.11', GPU: 'v100', DRIVER: 'latest' }
- { CUDA_VER: '12.2', ARCH: 'arm64', PYTHON_VER: '3.11', GPU: 'a100', DRIVER: 'latest' }
1 change: 1 addition & 0 deletions matrix.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,5 +5,6 @@ CUDA_VER: # Should be `<major>.<minor>.<patch>` (e.g. `11.2.2`)
PYTHON_VER:
- "3.9"
- "3.10"
- "3.11"
DASK_SQL_VER:
- "2024.1.0"
8 changes: 4 additions & 4 deletions raft-ann-bench/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ export DATA_FOLDER=path/to/store/results/and/data
docker run --gpus all --rm -it \
-v $DATA_FOLDER:/home/rapids/benchmarks \
-u $(id -u) \
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.10 \
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.11 \
"--dataset deep-image-96-angular" \
"--normalize" \
"--algorithms raft_cagra" \
Expand All @@ -50,7 +50,7 @@ export DATA_FOLDER=path/to/store/results/and/data # <- Results and datasets will
docker run --gpus all --rm -it \
-v $DATA_FOLDER:/home/rapids/benchmarks \ # <- local folder to store datasets and results
-u $(id -u) \ # <- this flag allows the container to use the host user for permissions
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.10 \ # <- image to use, either `raft-ann-bench` or `raft-ann-bench-datasets`
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.11 \ # <- image to use, either `raft-ann-bench` or `raft-ann-bench-datasets`
"--dataset deep-image-96-angular" \ # <- dataset name
"--normalize" \ # <- whether to normalize the dataset, leave string empty ("") to not normalize.
"--algorithms raft_cagra" \ # <- what algorithm(s) to use as a ; separated list, as well as any other argument to pass to `raft_ann_benchmarks.run`
Expand All @@ -63,7 +63,7 @@ export DATA_FOLDER=path/to/store/results/and/data
docker run all --rm -it \
-v $DATA_FOLDER:/home/rapids/benchmarks \
-u $(id -u) \ # <- this flag allows the container to use the host user for permissions
rapidsai/raft-ann-bench-cpu:24.04a-py3.10 \
rapidsai/raft-ann-bench-cpu:24.04a-py3.11 \
"--dataset deep-image-96-angular" \
"--normalize" \
"--algorithms raft_cagra" \
Expand All @@ -77,7 +77,7 @@ export DATA_FOLDER=path/to/store/results/and/data
docker run --gpus all --rm -it \
-v $DATA_FOLDER:/home/rapids/benchmarks \
-u $(id -u) \
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.10 \
rapidsai/raft-ann-bench:24.04a-cuda11.8-py3.11 \
--entrypoint /bin/bash
```

Expand Down
2 changes: 1 addition & 1 deletion raft-ann-bench/cpu/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# syntax=docker/dockerfile:1

ARG PYTHON_VER=3.10
ARG PYTHON_VER=3.11
ARG RAPIDS_VER=24.04

FROM condaforge/mambaforge:23.3.1-0 as raft-ann-bench-cpu
Expand Down
2 changes: 1 addition & 1 deletion raft-ann-bench/gpu/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# syntax=docker/dockerfile:1

ARG CUDA_VER=12.0.1
ARG PYTHON_VER=3.10
ARG PYTHON_VER=3.11
ARG LINUX_VER=ubuntu22.04

ARG RAPIDS_VER=24.04
Expand Down

0 comments on commit 4b52bab

Please sign in to comment.