RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
☆63Mar 17, 2025Updated last year
Alternatives and similar repositories for RWKV-LM
Users that are interested in RWKV-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- ☆10Oct 25, 2025Updated last year
- Complex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmark☆30Apr 22, 2025Updated last year
- [IROS'25] COCMT☆12Aug 14, 2025Updated last year
- UQ: Assessing Language Models on Unsolved Questions☆30Aug 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 26 Spotlight] Code for paper "VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding"☆21Jun 5, 2026Updated 4 months ago
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- GoldFinch and other hybrid transformer components☆47Jul 20, 2024Updated 2 years ago
- Train transformers on synthetic graph search problems to measure their scaling behavior and to do mechanistic analysis.☆10Oct 22, 2025Updated last year
- 🔮 美赛 (MCM/ICM) 论文获奖概率预测器。基于 NLP 语义分析与 XGBoost，将“玄学”与科学完美融合。内置 8-bit 复古像素风 GUI，支持多模态特征评估。☆16May 4, 2026Updated 6 months ago
- ☆12Jun 17, 2019Updated 7 years ago
- Vintix: Action Model via In-Context Reinforcement Learning - - — ICML 2025☆52May 23, 2025Updated last year
- ☆10Sep 20, 2023Updated 3 years ago
- Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)☆18Dec 5, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Feb 14, 2022Updated 4 years ago
- ☆18Apr 18, 2025Updated last year
- Facebook MCP server for automating posts, comment moderation, insights, and sentiment filtering.☆13Jun 19, 2025Updated last year
- STaR: Scalable Task-Conditioned Retrieval for Long-Horizon Multimodal Robot Memory☆15Jul 13, 2026Updated 3 months ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- Generic library for neural collapse and several derivative works on the phenomenon.☆17Apr 14, 2025Updated last year
- Artifacts for ATC '22 paper "Faster Software Packet Processing on FPGA NICs with eBPF Program Warping"☆18May 20, 2022Updated 4 years ago
- The implementation of "End-to-End Neural Speaker Diarization with an Iterative Adaptive Attractor Estimation", which is accepted by Neura…☆11Aug 27, 2023Updated 3 years ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆16Sep 8, 2022Updated 4 years ago
- Offical implementation of "Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning" (AAAI 2025)☆12May 19, 2025Updated last year
- [ECCV 2026] FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstruction☆15Jun 27, 2026Updated 4 months ago
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆15Apr 30, 2025Updated last year
- A high-efficiency text embedding and reranking model based on RWKV architecture.☆23Sep 12, 2026Updated last month
- ☆16Mar 26, 2025Updated last year
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆36Oct 3, 2024Updated 2 years ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆92Sep 12, 2025Updated last year
- ☆54Jul 18, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆93Aug 18, 2024Updated 2 years ago
- ☆72Sep 11, 2026Updated last month
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- Official repository for “From Trainee to Trainer: LLM-Designed Training Environment for RL with Multi-Agent Reasoning”“☆26Jun 15, 2026Updated 4 months ago
- ☆25Dec 13, 2024Updated last year
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆32Nov 12, 2024Updated last year
- [AAAI 2023 Oral] Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training☆14Apr 19, 2023Updated 3 years ago