RWKV (pronounced RwaKuv) is an RNN with great LLM performance and parallelizable like a Transformer. We are at RWKV7-G1 "GooseOne" reasoning model.
It's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctxlen, and free text embedding. And it's 100% attention-free, and a Linux Foundation AI project.
RWKV-Projects
RWKV-LM
Training RWKV (and latest developments)
RWKV-Runner
RWKV GUI with API (PC)
RWKV App
Run local RWKV on your phone (Android, iOS)
RWKV pip package
Official RWKV pip package
RWKV-PEFT
Finetuning RWKV (9GB VRAM can finetune 7B)
RWKV-server
WebGPU inference (NVIDIA/AMD/Intel), nf4/int8/fp16
More... (500+ RWKV projects)
Misc
RWKV raw weights
All latest RWKV weights
RWKV weights
HuggingFace-compatible RWKV weights
RWKV-related papers
RWKV wiki
with history of RWKV from v1 to v7 (note: AI-written)
RWKV-Papers
RWKV-7 explained
RWKV-7 illustrated
RWKV-6 illustrated
