JL-er / WorldRWKV
The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging different encoders, the project allows for flexible modality switching and aspires to achieve end-to-end cross-modal inference.
☆44Updated last month
Alternatives and similar repositories for WorldRWKV:
Users that are interested in WorldRWKV are comparing it to the libraries listed below
- ☆121Updated 3 weeks ago
- ☆18Updated 4 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆28Updated this week
- ☆34Updated last week
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆39Updated last week
- ☆22Updated 4 months ago
- RAG SYSTEM FOR RWKV☆46Updated 5 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆27Updated this week
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆40Updated 3 months ago
- State tuning tunes the state☆32Updated 2 months ago
- 用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆34Updated 3 months ago
- ☆34Updated 9 months ago
- A large-scale RWKV v6, v7(World, ARWKV, PRWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy o…☆35Updated this week
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆128Updated 9 months ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆49Updated 4 months ago
- This project is established for real-time training of the RWKV model.☆49Updated 11 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Updated 8 months ago
- ☆13Updated 4 months ago
- rwkv finetuning☆36Updated last year
- RWKV, in easy to read code☆72Updated last month
- RWKV centralised docs for the community☆24Updated last month
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆222Updated last month
- RWKV in nanoGPT style☆189Updated 10 months ago
- BlackGoose Rimer: RWKV as a Superior Architecture for Large-Scale Time Series Modeling☆21Updated last week
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆20Updated last week
- Evaluating LLMs with Dynamic Data☆86Updated 2 weeks ago
- Fast modular code to create and train cutting edge LLMs☆66Updated 11 months ago
- continous batching and parallel acceleration for RWKV6☆24Updated 10 months ago
- RWKV-7: Surpassing GPT☆84Updated 5 months ago
- Inference RWKV with multiple supported backends.☆43Updated this week