I have Nvidia GPU but I am getting error.

[stockarea]

I am getting error : Error response from daemon: unknown or invalid runtime name: nvidia

I did the configuration as required and when I run sudo docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

I am getting this output :

Sun Dec 24 09:53:47 2023       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.147.05   Driver Version: 525.147.05   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0 Off |                  N/A |
| N/A   45C    P8     4W /  50W |    163MiB /  4096MiB |     27%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|

This shows that docker is able to access nvidia GPU. So what is the issue here?

[phamquiluan]

Did you change anything from the config? Could you please show the full logs where we have the logs "Error response from daemon: unknown or invalid runtime name: nvidia". I'd like to see the context around it.

@stockarea

[stockarea]

No, I have not changed any config file.

That is the only error it is showing in the log.

[+] Running 1/0
 ⠋ Container go5-project-text_recognition-1   Recreate                                                                                                         0.0s 
 ✔ Container go5-project-table_recognition-1  Running                                                                                                          0.0s 
Error response from daemon: unknown or invalid runtime name: nvidia

[phamquiluan]

@stockarea it seems like we have a problem with the Nvidia runtime. Could you please check the recent issue raised by the community to see if it helps, I haven't meet this issue... For example: NVIDIA/nvidia-container-toolkit#150

[stockarea]

@phamquiluan I do have nvidia runtime installed as shown by sudo docker info | grep -i runtime

 Runtimes: io.containerd.runc.v2 nvidia runc
 Default Runtime: nvidia