From f2d3a33782e7d21cbd8ac4b32f6285fef9192f62 Mon Sep 17 00:00:00 2001 From: Ishaan Sehgal Date: Tue, 5 Mar 2024 11:29:22 -0800 Subject: [PATCH 1/3] feat: Update README.md Add compatible versions Signed-off-by: Ishaan Sehgal --- presets/README.md | 16 +++++++--------- 1 file changed, 7 insertions(+), 9 deletions(-) diff --git a/presets/README.md b/presets/README.md index b698e8e7d..d871ebc0e 100644 --- a/presets/README.md +++ b/presets/README.md @@ -1,15 +1,13 @@ # Kaito Preset Configurations The current supported model families with preset configurations are listed below. -|Model Family | -|----| -|[falcon](./models/falcon)| -|[llama2](./models/llama2)| -|[llama2chat](./models/llama2chat)| -|[mistral](./models/mistral)| -|[phi2](./models/phi)| - - +| Model Family | Compatible Kaito Versions | +|-----------------|---------------------------| +|[falcon](./models/falcon)| All Kaito Versions| +|[llama2](./models/llama2)| All Kaito Versions| +|[llama2chat](./models/llama2chat)| All Kaito Versions| +|[mistral](./models/mistral)| v0.2.0 | +|[phi2](./models/phi)| v0.2.0 | ## Validation Each preset model has its own hardware requirements in terms of GPU count and GPU memory defined in the respective `model.go` file. Kaito controller performs a validation check of whether the specified SKU and node count are sufficient to run the model or not. In case the provided SKU is not in the known list, the controller bypasses the validation check which means users need to ensure the model can run with the provided SKU. From 121de6d0dbd37416646d7493bb7898ad787cda08 Mon Sep 17 00:00:00 2001 From: Ishaan Sehgal Date: Tue, 5 Mar 2024 11:41:19 -0800 Subject: [PATCH 2/3] Update README.md Signed-off-by: Ishaan Sehgal --- presets/README.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/presets/README.md b/presets/README.md index d871ebc0e..532a86b5e 100644 --- a/presets/README.md +++ b/presets/README.md @@ -3,11 +3,11 @@ The current supported model families with preset configurations are listed below | Model Family | Compatible Kaito Versions | |-----------------|---------------------------| -|[falcon](./models/falcon)| All Kaito Versions| -|[llama2](./models/llama2)| All Kaito Versions| -|[llama2chat](./models/llama2chat)| All Kaito Versions| -|[mistral](./models/mistral)| v0.2.0 | -|[phi2](./models/phi)| v0.2.0 | +|[falcon](./models/falcon)| 0.0.1+| +|[llama2](./models/llama2)| 0.0.1+| +|[llama2chat](./models/llama2chat)| 0.0.1+| +|[mistral](./models/mistral)| v0.2.0+| +|[phi2](./models/phi)| v0.2.0+| ## Validation Each preset model has its own hardware requirements in terms of GPU count and GPU memory defined in the respective `model.go` file. Kaito controller performs a validation check of whether the specified SKU and node count are sufficient to run the model or not. In case the provided SKU is not in the known list, the controller bypasses the validation check which means users need to ensure the model can run with the provided SKU. From 6470cc5e806a232237ef5ac06be935598b54ed1e Mon Sep 17 00:00:00 2001 From: Ishaan Sehgal Date: Tue, 5 Mar 2024 11:41:45 -0800 Subject: [PATCH 3/3] Update README.md Signed-off-by: Ishaan Sehgal --- presets/README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/presets/README.md b/presets/README.md index 532a86b5e..ae8dfa31c 100644 --- a/presets/README.md +++ b/presets/README.md @@ -3,9 +3,9 @@ The current supported model families with preset configurations are listed below | Model Family | Compatible Kaito Versions | |-----------------|---------------------------| -|[falcon](./models/falcon)| 0.0.1+| -|[llama2](./models/llama2)| 0.0.1+| -|[llama2chat](./models/llama2chat)| 0.0.1+| +|[falcon](./models/falcon)| v0.0.1+| +|[llama2](./models/llama2)| v0.0.1+| +|[llama2chat](./models/llama2chat)| v0.0.1+| |[mistral](./models/mistral)| v0.2.0+| |[phi2](./models/phi)| v0.2.0+|