Skip to content

Commit

Permalink
feat: Update Preset Model Tags (#574)
Browse files Browse the repository at this point in the history
**Reason for Change**:
PR serves to trigger the build pipeline to update preset model images.
  • Loading branch information
ishaansehgal99 authored Aug 23, 2024
1 parent 1afb924 commit 2e967ca
Show file tree
Hide file tree
Showing 3 changed files with 21 additions and 13 deletions.
2 changes: 1 addition & 1 deletion presets/inference/text-generation/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ transformers==4.41.2
torch==2.2.0
accelerate==0.30.1
fastapi>=0.111.0,<0.112.0 # Allow patch updates
pydantic>=2.7.1,<2.8 # Allow patch updates
pydantic==2.7.4
uvicorn[standard]>=0.29.0,<0.30.0 # Allow patch updates
peft==0.11.1
numpy==1.22.4
Expand Down
30 changes: 19 additions & 11 deletions presets/models/supported_models.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,13 +34,14 @@ models:
type: text-generation
version: https://huggingface.co/tiiuae/falcon-7b/commit/898df1396f35e447d5fe44e0a3ccaaaa69f30d36
runtime: tfs
tag: 0.0.5
tag: 0.0.6
- name: falcon-7b-instruct
type: text-generation
version: https://huggingface.co/tiiuae/falcon-7b-instruct/commit/cf4b3c42ce2fdfe24f753f0f0d179202fea59c99
runtime: tfs
tag: 0.0.5
tag: 0.0.6
# Tag history:
# 0.0.6 - Add Logging & Metrics Server
# 0.0.5 - Tuning and Adapters
# 0.0.4 - Adjust default model params (#310)
# 0.0.3 - Update Default Params (#294)
Expand All @@ -50,13 +51,14 @@ models:
type: text-generation
version: https://huggingface.co/tiiuae/falcon-40b/commit/4a70170c215b36a3cce4b4253f6d0612bb7d4146
runtime: tfs
tag: 0.0.6
tag: 0.0.7
- name: falcon-40b-instruct
type: text-generation
version: https://huggingface.co/tiiuae/falcon-40b-instruct/commit/ecb78d97ac356d098e79f0db222c9ce7c5d9ee5f
runtime: tfs
tag: 0.0.6
tag: 0.0.7
# Tag history for 40b models:
# 0.0.7 - Add Logging & Metrics Server
# 0.0.6 - Tuning and Adapters
# 0.0.5 - Adjust default model params (#310)
# 0.0.4 - Skipped due to incomplete upload issue
Expand All @@ -69,13 +71,14 @@ models:
type: text-generation
version: https://huggingface.co/mistralai/Mistral-7B-v0.3/commit/c882233d224d27b727b3d9299b12a9aab9dda6f7
runtime: tfs
tag: 0.0.6
tag: 0.0.7
- name: mistral-7b-instruct
type: text-generation
version: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3/commit/0417f4babd26db0b5ed07c1d0bc85658ab526ea3
runtime: tfs
tag: 0.0.6
tag: 0.0.7
# Tag history:
# 0.0.7 - Add Logging & Metrics Server
# 0.0.6 - Update model version and Address missing weights files fix
# 0.0.5 - Tuning and Adapters
# 0.0.4 - Adjust default model params (#310)
Expand All @@ -88,8 +91,9 @@ models:
type: text-generation
version: https://huggingface.co/microsoft/phi-2/commit/b10c3eba545ad279e7208ee3a5d644566f001670
runtime: tfs
tag: 0.0.4
tag: 0.0.5
# Tag history:
# 0.0.5 - Add Logging & Metrics Server
# 0.0.4 - Tuning and Adapters
# 0.0.3 - Adjust default model params (#310)
# 0.0.2 - Update Default Params (#294)
Expand All @@ -100,30 +104,34 @@ models:
type: text-generation
version: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct/commit/d269012bea6fbe38ce7752c8940fea010eea3383
runtime: tfs
tag: 0.0.1
tag: 0.0.2
# Tag history:
# 0.0.2 - Add Logging & Metrics Server
# 0.0.1 - Initial Release

- name: phi-3-mini-128k-instruct
type: text-generation
version: https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/commit/5be6479b4bc06a081e8f4c6ece294241ccd32dec
runtime: tfs
tag: 0.0.1
tag: 0.0.2
# Tag history:
# 0.0.2 - Add Logging & Metrics Server
# 0.0.1 - Initial Release

- name: phi-3-medium-4k-instruct
type: text-generation
version: https://huggingface.co/microsoft/Phi-3-medium-4k-instruct/commit/d194e4e74ffad5a5e193e26af25bcfc80c7f1ffc
runtime: tfs
tag: 0.0.1
tag: 0.0.2
# Tag history:
# 0.0.2 - Add Logging & Metrics Server
# 0.0.1 - Initial Release

- name: phi-3-medium-128k-instruct
type: text-generation
version: https://huggingface.co/microsoft/Phi-3-medium-128k-instruct/commit/cae1d42b5577398fd1be9f0746052562ae552886
runtime: tfs
tag: 0.0.1
tag: 0.0.2
# Tag history:
# 0.0.2 - Add Logging & Metrics Server
# 0.0.1 - Initial Release
2 changes: 1 addition & 1 deletion presets/tuning/text-generation/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ transformers==4.41.2
torch==2.2.0
accelerate==0.30.1
fastapi>=0.111.0,<0.112.0 # Allow patch updates
pydantic>=2.7.1,<2.8 # Allow patch updates
pydantic==2.7.4
uvicorn[standard]>=0.29.0,<0.30.0 # Allow patch updates

# Utility libraries
Expand Down

0 comments on commit 2e967ca

Please sign in to comment.