llama : accept a list of devices to use to offload a model #16989
| Job | Run time |
|---|---|
| 1s | |
| 1s | |
| 1s | |
| 8s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 0s | |
| 1s | |
| 1s | |
| 1s | |
| 49s |
| Job | Run time |
|---|---|
| 1s | |
| 1s | |
| 1s | |
| 8s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 0s | |
| 1s | |
| 1s | |
| 1s | |
| 49s |