Mini_RWKV_V7_LM Only 34.2M params (also have RWKV7s architecture [deep embedding]/[deep embedding attention) with Full Training code & datasets & inference
☆95Jan 26, 2026Updated 8 months ago
Alternatives and similar repositories for Mini_RWKV_7
Users that are interested in Mini_RWKV_7 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Softened ROSA QKV Operators for Training Next-Generation LLM Models☆39Sep 13, 2026Updated last month
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆64May 13, 2026Updated 5 months ago
- Inference RWKV with multiple supported backends.☆100Sep 4, 2026Updated last month
- ☆12Aug 2, 2026Updated 2 months ago
- 🚀 轻量视频🎥 大模型🤖☆23Apr 27, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090☆133Sep 10, 2026Updated last month
- ☆186Jan 13, 2026Updated 9 months ago
- 轻量级大语言模型MiniMind的源码解读，包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程☆1,219Jun 16, 2025Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆60Mar 31, 2026Updated 6 months ago
- RWKV Batch infer backend ⚡Base on albatross https://github.com/BlinkDL/Albatross 🕊️☆37Jul 27, 2026Updated 2 months ago
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆70Mar 18, 2026Updated 6 months ago
- ☆12Dec 21, 2024Updated last year
- ☆41Apr 30, 2025Updated last year
- Inference RWKV v7 in pure C.☆47Oct 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Practical AI with PyTorch 2024☆34Jan 5, 2025Updated last year
- ☆23Sep 8, 2026Updated last month
- ☆19Aug 1, 2024Updated 2 years ago
- PyTorch implementation of RWKV blocks☆31Jul 22, 2025Updated last year
- [MM 2022] MM-ALT: A Multimodal Automatic Lyric Transcription System (Oral, Top paper award)☆21Mar 16, 2024Updated 2 years ago
- RWKV-RAG个人版☆28Aug 6, 2025Updated last year
- AI拆解论文，人人都能读懂前沿研究☆26Jul 10, 2026Updated 3 months ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- ☆51Jul 3, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- AnyAccomp: Generalizable accompaniment generation for vocals and solo instruments, powered by a quantized melodic bottleneck.☆40Dec 22, 2025Updated 9 months ago
- An agent of personal activity monitoring system for Windows desktop.☆12Sep 19, 2018Updated 8 years ago
- State tuning tunes the state☆34Feb 12, 2025Updated last year
- ☆30Jan 12, 2025Updated last year
- This project is established for real-time training of the RWKV model.☆48May 17, 2024Updated 2 years ago
- Code for the paper: Rehearsal-free Continual Language Learning via Efficient Parameter Isolation☆13May 16, 2023Updated 3 years ago
- This repo offers advanced tutorials for LLMs, BERT-based models, and multimodal models, covering fine-tuning, quantization, vocabulary ex…☆23May 5, 2025Updated last year
- CPAPro, a modern CLIProxyAPI panel.☆24Jun 11, 2026Updated 4 months ago
- 一个完整的 LLM 训练的基本流程笔记 (Tokenizer -> PreTraining -> SFT -> DPO -> GRPO)☆29Feb 23, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A Cuengh(Zhuang) - Chinse dictionary written in Python☆15Sep 2, 2021Updated 5 years ago
- Feedforward Sequential Memory Networks☆18Aug 2, 2022Updated 4 years ago
- 🍭 stm32F407-atk-explorer 开发板 RT-Thread MicroPython 固件☆11Mar 8, 2020Updated 6 years ago
- A Top-Down Profiler for GPU Applications☆24Feb 29, 2024Updated 2 years ago
- A Python QQ robot backend based on the Shamrock framework, which is used to connect large language models RWKV to QQ.一个基于Shamrock框架的Pytho…☆23Mar 20, 2024Updated 2 years ago
- An AI Library for Plasma Physics Simulation☆39Mar 1, 2026Updated 7 months ago
- [ACL 2026 Main] Official Repo for Paper "Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Ali…☆17Jul 1, 2026Updated 3 months ago