Skip to content

Commit

Permalink
chore: Update Phi README.md (#593)
Browse files Browse the repository at this point in the history
**Reason for Change**:
Update links in Phi-3 readme to valid examples

---------

Signed-off-by: Ishaan Sehgal <ishaanforthewin@gmail.com>
Signed-off-by: ishaansehgal99 <ishaanforthewin@gmail.com>
  • Loading branch information
ishaansehgal99 authored Sep 10, 2024
1 parent 6b8bc80 commit bcc0276
Show file tree
Hide file tree
Showing 6 changed files with 29 additions and 7 deletions.
12 changes: 12 additions & 0 deletions examples/inference/kaito_workspace_phi_3_medium_128k.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
apiVersion: kaito.sh/v1alpha1
kind: Workspace
metadata:
name: workspace-phi-3-medium
resource:
instanceType: "Standard_NC24ads_A100_v4"
labelSelector:
matchLabels:
apps: phi-3
inference:
preset:
name: phi-3-medium-128k-instruct
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,3 @@ resource:
inference:
preset:
name: phi-3-medium-4k-instruct
# Note: This configuration also works with the phi-3-medium-128k-instruct preset
12 changes: 12 additions & 0 deletions examples/inference/kaito_workspace_phi_3_mini_128k.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
apiVersion: kaito.sh/v1alpha1
kind: Workspace
metadata:
name: workspace-phi-3-mini
resource:
instanceType: "Standard_NC6s_v3"
labelSelector:
matchLabels:
apps: phi-3
inference:
preset:
name: phi-3-mini-128k-instruct
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,3 @@ resource:
inference:
preset:
name: phi-3-mini-4k-instruct
# Note: This configuration also works with the phi-3-mini-128k-instruct preset
2 changes: 1 addition & 1 deletion presets/models/phi2/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
## Supported Models
|Model name| Model source | Sample workspace|Kubernetes Workload|Distributed inference|
|----|:----:|:----:| :----: |:----: |
|phi-2 |[microsoft](https://huggingface.co/microsoft/phi-2)|[link](../../../examples/inference/kaito_workspace_phi_3.yaml)|Deployment| false|
|phi-2 |[microsoft](https://huggingface.co/microsoft/phi-2)|[link](../../../examples/inference/kaito_workspace_phi_2.yaml)|Deployment| false|


## Image Source
Expand Down
8 changes: 4 additions & 4 deletions presets/models/phi3/README.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
## Supported Models
| Model name | Model source | Sample workspace|Kubernetes Workload|Distributed inference|
|--------------------------|:-----------------------------------------------------------------------:|:----:| :----: |:----: |
| phi-3-mini-4k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3.yaml)|Deployment| false|
| phi-3-mini-128k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3.yaml)|Deployment| false|
| phi-3-mini-4k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-medium-4k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3.yaml)|Deployment| false|
| phi-3-mini-128k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3.yaml)|Deployment| false|
| phi-3-mini-4k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3_mini_4k.yaml)|Deployment| false|
| phi-3-mini-128k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3_mini_128k.yaml)|Deployment| false|
| phi-3-medium-4k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-medium-4k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3_medium_4k.yaml)|Deployment| false|
| phi-3-medium-128k-instruct | [microsoft](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) |[link](../../../examples/inference/kaito_workspace_phi_3_medium_128k.yaml)|Deployment| false|

## Image Source
- **Public**: Kaito maintainers manage the lifecycle of the inference service images that contain model weights. The images are available in Microsoft Container Registry (MCR).
Expand Down

0 comments on commit bcc0276

Please sign in to comment.