yuunnn-w / RWKV_PytorchLinks
This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation is overly complex and lacks extensibility. Let's join the flexible PyTorch ecosystem and open-source it together!
☆128Updated 11 months ago
Alternatives and similar repositories for RWKV_Pytorch
Users that are interested in RWKV_Pytorch are comparing it to the libraries listed below
Sorting:
- ☆129Updated last week
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆227Updated 3 weeks ago
- RAG SYSTEM FOR RWKV☆49Updated 6 months ago
- ☆18Updated 5 months ago
- ☆13Updated 6 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆33Updated last week
- Evaluating LLMs with Dynamic Data☆93Updated last month
- This project is established for real-time training of the RWKV model.☆49Updated last year
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆44Updated last month
- rwkv finetuning☆36Updated last year
- Inference RWKV with multiple supported backends.☆50Updated last week
- 用户友好、开箱即用的 RWKV Prompts 示例 ,适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆35Updated 5 months ago
- ☆23Updated 5 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆72Updated this week
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆50Updated last month
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Updated 10 months ago
- ☆124Updated last year
- This project is to extend RWKV LM's capabilities including sequence classification/embedding/peft/cross encoder/bi encoder/multi modaliti…☆10Updated 10 months ago
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆28Updated last week
- ☆82Updated last year
- RWKV in nanoGPT style☆191Updated last year
- continous batching and parallel acceleration for RWKV6☆24Updated 11 months ago
- RWKV, in easy to read code☆72Updated 2 months ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆51Updated 6 months ago
- A large-scale RWKV v6, v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to de…☆38Updated 3 weeks ago
- The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )☆222Updated 6 months ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆310Updated last week
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆41Updated 5 months ago
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆313Updated 4 months ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言模型,力求以更小的算力和资源实…☆38Updated last year