JL-er / WorldRWKVLinks
The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging different encoders, the project allows for flexible modality switching and aspires to achieve end-to-end cross-modal inference.
☆47Updated 2 weeks ago
Alternatives and similar repositories for WorldRWKV
Users that are interested in WorldRWKV are comparing it to the libraries listed below
Sorting:
- ☆18Updated 5 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆29Updated last week
- ☆34Updated last month
- ☆124Updated this week
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆37Updated last month
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated last month
- ☆22Updated 5 months ago
- A large-scale RWKV v6, v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to de…☆35Updated this week
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆42Updated 2 weeks ago
- State tuning tunes the state☆33Updated 3 months ago
- RWKV-7: Surpassing GPT☆88Updated 6 months ago
- rwkv finetuning☆36Updated last year
- Inference RWKV with multiple supported backends.☆48Updated this week
- This project is established for real-time training of the RWKV model.☆49Updated last year
- RAG SYSTEM FOR RWKV☆49Updated 6 months ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆50Updated 5 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆67Updated last week
- ☆34Updated 10 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆34Updated 11 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆147Updated 9 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆44Updated 2 months ago
- ☆13Updated 5 months ago
- ☆14Updated last week
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆226Updated this week
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆128Updated 10 months ago
- continous batching and parallel acceleration for RWKV6☆24Updated 11 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆40Updated 4 months ago
- ☆31Updated last year
- Here we will test various linear attention designs.☆58Updated last year
- RWKV centralised docs for the community☆25Updated 2 months ago