Joluck / RWKV-PEFTView external linksLinks
☆171Jan 13, 2026Updated last month
Alternatives and similar repositories for RWKV-PEFT
Users that are interested in RWKV-PEFT are comparing it to the libraries listed below
Sorting:
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆62Sep 19, 2025Updated 4 months ago
- 用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆35Jan 24, 2025Updated last year
- 更简单的微调，提供便捷脚本，微调说明☆38May 30, 2025Updated 8 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆48Aug 22, 2025Updated 5 months ago
- ☆27Jul 28, 2025Updated 6 months ago
- RAG SYSTEM FOR RWKV☆52Dec 4, 2024Updated last year
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Aug 13, 2024Updated last year
- ☆17Jan 1, 2025Updated last year
- State tuning tunes the state☆35Feb 12, 2025Updated last year
- Implementation of the RWKV language model in pure WebGPU/Rust.☆340Jan 10, 2026Updated last month
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆47Oct 21, 2025Updated 3 months ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated last year
- ☆13Dec 21, 2024Updated last year
- Evaluating LLMs with Dynamic Data☆111Updated this week
- Efficient RWKV inference engine. RWKV7 7.2B fp16 decoding 10250 tps @ single 5090.☆78Feb 1, 2026Updated last week
- This project is established for real-time training of the RWKV model.☆50May 17, 2024Updated last year
- Mini Model Daemon☆12Nov 9, 2024Updated last year
- ☆12Dec 14, 2024Updated last year
- A fast RWKV Tokenizer written in Rust☆54Aug 12, 2025Updated 6 months ago
- continous batching and parallel acceleration for RWKV6☆22Jun 28, 2024Updated last year
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆244Jan 13, 2026Updated last month
- ☆41Apr 30, 2025Updated 9 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆43Jan 25, 2025Updated last year
- A fast, lightweight, and extensible RWKV chat UI powered by Flutter. Offline-ready, multi-backend support, ideal for local RWKV inference…☆68Updated this week
- ☆23Dec 28, 2024Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆54Jan 12, 2026Updated last month
- ☆147Nov 22, 2024Updated last year
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- Fast modular code to create and train cutting edge LLMs☆68May 16, 2024Updated last year
- MiSS is a novel PEFT method that features a low-rank structure but introduces a new update mechanism distinct from LoRA, achieving an exc…☆30Jan 28, 2026Updated 2 weeks ago
- ☆13May 11, 2025Updated 9 months ago
- A 100% locally run AI web tool for generating WeChat replies using the RWKV runner☆10Oct 29, 2024Updated last year
- ☆10Aug 18, 2023Updated 2 years ago
- rwkv finetuning☆37Apr 22, 2024Updated last year
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆412Jul 11, 2023Updated 2 years ago
- Fine-tuning RWKV-World model☆26Jun 6, 2023Updated 2 years ago
- RWKV v5,v6 LoRA Trainer on Cuda and Rocm Platform. RWKV is a RNN with transformer-level LLM performance. It can be directly trained like …☆13Mar 24, 2024Updated last year
- ☆32May 26, 2024Updated last year
- This project demonstrates the computation process of the RWKV (Receptance Weighted Key Value) model through Excel spreadsheets.☆18Jun 7, 2025Updated 8 months ago