RWKV Batch infer backend ⚡Base on albatross https://github.com/BlinkDL/Albatross 🕊️
☆37Jul 27, 2026Updated 2 months ago
Alternatives and similar repositories for rwkv_lightning
Users that are interested in rwkv_lightning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090☆132Sep 10, 2026Updated last month
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15Sep 4, 2026Updated last month
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆70Mar 18, 2026Updated 6 months ago
- RWKV centralised docs for the community☆35Jan 17, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Aug 2, 2026Updated 2 months ago
- ROSA-Tuning☆71Feb 4, 2026Updated 8 months ago
- A high-efficiency text embedding and reranking model based on RWKV architecture.☆22Sep 12, 2026Updated 3 weeks ago
- This project demonstrates the computation process of the RWKV (Receptance Weighted Key Value) model through Excel spreadsheets.☆21Jun 7, 2025Updated last year
- This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…☆134Jul 20, 2024Updated 2 years ago
- Inference RWKV with multiple supported backends.☆100Sep 4, 2026Updated last month
- A 20M RWKV v6 can do nonogram☆13Oct 18, 2024Updated last year
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆64May 13, 2026Updated 4 months ago
- ☆28Feb 26, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆46Jan 25, 2025Updated last year
- Agen is a minimalist language for agent loops and state machines.☆49Mar 30, 2026Updated 6 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆102Oct 8, 2025Updated last year
- 用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆35Apr 13, 2026Updated 5 months ago
- Solving puzzles with RWKV locally in your browser.☆14Mar 31, 2026Updated 6 months ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- 更简单的微调，提供便捷脚本，微调说明☆36May 30, 2025Updated last year
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆51Apr 2, 2026Updated 6 months ago
- ☆17Jan 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆99Jul 27, 2026Updated 2 months ago
- Evaluating LLMs with Dynamic Data☆124Sep 24, 2026Updated 2 weeks ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆52Oct 21, 2025Updated 11 months ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆360Jun 1, 2026Updated 4 months ago
- Flutter adapter and Dart FFI runtime bridge for on-device inference with rwkv-mobile.☆20Sep 30, 2026Updated last week
- VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.☆246Jan 13, 2026Updated 8 months ago
- Cross-platform, local-first RWKV chat built with Flutter for Android, iOS, Windows, macOS, and Linux.☆131Oct 1, 2026Updated last week
- ☆12Dec 14, 2024Updated last year
- ☆24Dec 28, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Inference RWKV v7 in pure C.☆47Oct 10, 2025Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆60Mar 31, 2026Updated 6 months ago
- A fast RWKV Tokenizer written in Rust☆55Jul 26, 2026Updated 2 months ago
- RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained …☆29Jan 1, 2025Updated last year
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆30Apr 15, 2024Updated 2 years ago
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.☆622Jun 9, 2026Updated 4 months ago