Skip to content

Commit

Permalink
Merge branch 'main' into stream-with-chat
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt authored May 30, 2024
2 parents 7a16f11 + f6654e8 commit f614245
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,11 @@

Uses the latest state-of-the-art techniques:

✅ flash attention     ✅ fp4/8/16/32     ✅ LoRA, QLoRA, Adapter (v1, v2)     ✅ FSDP     ✅ 1-1000+ GPUs/TPUs
<pre>
✅ flash attention ✅ fp4/8/16/32 ✅ LoRA, QLoRA, Adapter
✅ FSDP ✅ 1-1000+ GPUs/TPUs ✅ 20+ LLMs
</pre>


---

Expand Down

0 comments on commit f614245

Please sign in to comment.