This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation is overly complex and lacks extensibility. Let's join the flexible PyTorch ecosystem and open-source it together!
☆133Jul 20, 2024Updated last year
Alternatives and similar repositories for RWKV_Pytorch
Users that are interested in RWKV_Pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Python QQ robot backend based on the Shamrock framework, which is used to connect large language models RWKV to QQ.一个基于Shamrock框架的Pytho…☆23Mar 20, 2024Updated 2 years ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆48Apr 2, 2026Updated 2 months ago
- ☆12Dec 21, 2024Updated last year
- ☆179Jan 13, 2026Updated 5 months ago
- The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.☆616Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RWKV6 in native pytorch and triton:)☆11Aug 4, 2024Updated last year
- ☆17Aug 1, 2023Updated 2 years ago
- A 20M RWKV v6 can do nonogram☆13Oct 18, 2024Updated last year
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15May 20, 2026Updated 3 weeks ago
- 更简单的微调，提供便捷脚本，微调说明☆35May 30, 2025Updated last year
- ☆22Dec 28, 2024Updated last year
- ☆20Aug 1, 2024Updated last year
- RWKV centralised docs for the community☆34Jan 17, 2026Updated 4 months ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆49Oct 21, 2025Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆93Jun 8, 2026Updated last week
- Implementation of the RWKV language model in pure WebGPU/Rust.☆354Jun 1, 2026Updated 2 weeks ago
- ☆12Feb 20, 2026Updated 3 months ago
- ☆27Feb 26, 2026Updated 3 months ago
- continous batching and parallel acceleration for RWKV6☆22Jun 28, 2024Updated last year
- Fast modular code to create and train cutting edge LLMs☆67May 16, 2024Updated 2 years ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆147Aug 13, 2024Updated last year
- ☆17Jan 1, 2025Updated last year
- RAG SYSTEM FOR RWKV☆53Dec 4, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Evaluating LLMs with Dynamic Data☆115May 9, 2026Updated last month
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- BlackGoose Rimer: RWKV as a Superior Architecture for Large-Scale Time Series Modeling☆32Jul 11, 2025Updated 11 months ago
- State tuning tunes the state☆35Feb 12, 2025Updated last year
- Inference RWKV with multiple supported backends.☆92Jun 7, 2026Updated last week
- Solving puzzles with RWKV locally in your browser.☆13Mar 31, 2026Updated 2 months ago
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆68Mar 18, 2026Updated 2 months ago
- This project demonstrates the computation process of the RWKV (Receptance Weighted Key Value) model through Excel spreadsheets.☆21Jun 7, 2025Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆58Mar 31, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- A fast RWKV Tokenizer written in Rust☆54Aug 12, 2025Updated 10 months ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆312Jan 31, 2024Updated 2 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Tasks☆125Aug 16, 2024Updated last year
- RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090☆115Jun 7, 2026Updated last week
- ☆34May 20, 2026Updated 3 weeks ago