PinnedLoading

1. RWKV-LMRWKV-LMPublic

   RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RN…

   Python 13.4k 900

2. ChatRWKVChatRWKVPublic

   ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

   Python 9.5k 704

3. modded-nanogpt-rwkvmodded-nanogpt-rwkvPublic

   Forked fromKellerJordan/modded-nanogpt

   RWKV-7: Surpassing GPT

   Python 82 9

4. LinearAttentionArenaLinearAttentionArenaPublic

   Here we will test various linear attention designs.

   Python 60 6

5. nanoRWKVnanoRWKVPublic

   Forked fromkarpathy/nanoGPT

   RWKV in nanoGPT style

   Python 187 11

6. RWKV-CUDARWKV-CUDAPublic

   The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

   Cuda 220 35