CB: rely on CPU logic for KV cache precision and shape (#1838) #8
Job | Run time |
---|---|
1s | |
32m 27s | |
1d 0h 0m 1s | |
16m 33s | |
15m 5s | |
1s | |
1s | |
1s | |
30m 1s | |
1d 0h 0m 1s | |
1d 0h 0m 1s | |
31m 13s | |
1s | |
2s | |
3d 2h 5m 29s |
Job | Run time |
---|---|
1s | |
32m 27s | |
1d 0h 0m 1s | |
16m 33s | |
15m 5s | |
1s | |
1s | |
1s | |
30m 1s | |
1d 0h 0m 1s | |
1d 0h 0m 1s | |
31m 13s | |
1s | |
2s | |
3d 2h 5m 29s |