Skip to content
#

gpt

Star

Here are 1,972 public repositories matching this topic...

Language: Python
Filter by language
All 5,041 Python 1,972 TypeScript 614 Jupyter Notebook 470 JavaScript 461 Go 140 HTML 131 Rust 90 C# 77 PHP 71 Java 63
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

BlinkDL / RWKV-LM

Star 13.5k

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

deep-learning transformers pytorch transformer lstm rnn gpt language-model attention-mechanism gpt-2 gpt-3 linear-attention rwkv chatgpt
  • Updated Apr 7, 2025
  • Python

Improve this page

Add a description, image, and links to the gpt topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpt topic, visit your repo's landing page and select "manage topics."

Learn more