Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ltoniazzi authored Aug 16, 2024
1 parent 96b8b73 commit 62306b8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ This is done to get a lightweight version of the same architecture, for testing.

- Reduced models can be found in [this HF ggml-org repo](https://huggingface.co/ggml-org/lora-tests). Currently supported LLMs:

|Architecture|HF repo|hidden size|base MB|lora MB|
|Architecture|HF repo|hidden size|base (MB)|lora (MB)|
|---|---|---|---|---|
|`Phi3ForCausalLM`| `microsoft/Phi-3-mini-4k-instruct`|64|20|12|
|`LlamaForCausalLM`| `meta-llama/Meta-Llama-3-8B-Instruct`|64|68|52|
Expand Down

0 comments on commit 62306b8

Please sign in to comment.