yuunnn-w / RWKV_PytorchLinks
This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation is overly complex and lacks extensibility. Let's join the flexible PyTorch ecosystem and open-source it together!
☆130Updated last year
Alternatives and similar repositories for RWKV_Pytorch
Users that are interested in RWKV_Pytorch are comparing it to the libraries listed below
Sorting:
- ☆150Updated this week
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆237Updated 4 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆45Updated 2 months ago
- Evaluating LLMs with Dynamic Data☆96Updated 3 months ago
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆54Updated last month
- RAG SYSTEM FOR RWKV☆52Updated 10 months ago
- 用户友好、开箱即用的 RWKV Prompts 示例,适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆36Updated 9 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆147Updated last year
- This project is established for real-time training of the RWKV model.☆49Updated last year
- rwkv finetuning☆37Updated last year
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆330Updated 8 months ago
- ☆17Updated 9 months ago
- ☆22Updated 10 months ago
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆46Updated 3 months ago
- continous batching and parallel acceleration for RWKV6☆23Updated last year
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆58Updated last week
- ☆13Updated 10 months ago
- ☆81Updated last year
- State tuning tunes the state☆35Updated 8 months ago
- ☆124Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆85Updated this week
- Low-bit optimizers for PyTorch☆132Updated 2 years ago
- RWKV, in easy to read code☆72Updated 7 months ago
- RWKV in nanoGPT style☆193Updated last year
- Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels☆108Updated 2 years ago
- A quantization algorithm for LLM☆143Updated last year
- Inference RWKV with multiple supported backends.☆62Updated this week
- This project is to extend RWKV LM's capabilities including sequence classification/embedding/peft/cross encoder/bi encoder/multi modaliti…☆10Updated last year
- Lion and Adam optimization comparison☆64Updated 2 years ago
- A minimal, easy-to-read PyTorch reimplementation of the Qwen3 and Qwen2.5 VL with a fancy CLI☆174Updated last month