JL-er / WorldRWKVLinks
The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging different encoders, the project allows for flexible modality switching and aspires to achieve end-to-end cross-modal inference.
☆50Updated last month
Alternatives and similar repositories for WorldRWKV
Users that are interested in WorldRWKV are comparing it to the libraries listed below
Sorting:
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆28Updated last week
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆33Updated last week
- ☆18Updated 5 months ago
- ☆36Updated last month
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆44Updated last month
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆39Updated last month
- ☆129Updated last week
- This project is to extend RWKV LM's capabilities including sequence classification/embedding/peft/cross encoder/bi encoder/multi modaliti…☆10Updated 10 months ago
- A large-scale RWKV v6, v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to de…☆38Updated 3 weeks ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated last month
- MiSS is a novel PEFT method that features a low-rank structure but introduces a new update mechanism distinct from LoRA, achieving an exc…☆19Updated this week
- ☆23Updated 5 months ago
- BlackGoose Rimer: RWKV as a Superior Architecture for Large-Scale Time Series Modeling☆24Updated last week
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆51Updated 6 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆41Updated 5 months ago
- State tuning tunes the state☆33Updated 4 months ago
- ☆34Updated 11 months ago
- RAG SYSTEM FOR RWKV☆49Updated 6 months ago
- ☆13Updated 6 months ago
- RWKV-7 mini☆11Updated 2 months ago
- [EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner☆136Updated last month
- ☆22Updated this week
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆227Updated 3 weeks ago
- rwkv finetuning☆36Updated last year
- RWKV, in easy to read code☆72Updated 2 months ago
- RWKV-7: Surpassing GPT☆91Updated 7 months ago
- Inference RWKV with multiple supported backends.☆50Updated last week
- This project is established for real-time training of the RWKV model.☆49Updated last year
- RWKV centralised docs for the community☆27Updated 2 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆72Updated this week