Softened ROSA QKV Operators for Training Next-Generation LLM Models
☆39Jun 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for rosa_soft
Users that are interested in rosa_soft are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ROSA+: RWKV's ROSA implementation with fallback statistical predictor☆36Oct 13, 2025Updated 9 months ago
- RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090☆122Updated this week
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆64Sep 19, 2025Updated 10 months ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆51Oct 21, 2025Updated 9 months ago
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15Jun 10, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- This project demonstrates the computation process of the RWKV (Receptance Weighted Key Value) model through Excel spreadsheets.☆21Jun 7, 2025Updated last year
- ☆20Aug 1, 2024Updated last year
- ☆14May 11, 2025Updated last year
- State tuning tunes the state☆35Feb 12, 2025Updated last year
- 用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.☆34Apr 13, 2026Updated 3 months ago
- A high-efficiency text embedding and reranking model based on RWKV architecture.☆19Jan 10, 2026Updated 6 months ago
- ☆183Jan 13, 2026Updated 6 months ago
- RWKV centralised docs for the community☆35Jan 17, 2026Updated 6 months ago
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆69Mar 18, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Solving puzzles with RWKV locally in your browser.☆13Mar 31, 2026Updated 3 months ago
- RWKV Batch infer backend ⚡Base on albatross https://github.com/BlinkDL/Albatross 🕊️☆36Updated this week
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆50Apr 2, 2026Updated 3 months ago
- RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework☆62May 13, 2026Updated 2 months ago
- ☆48Jul 3, 2026Updated 3 weeks ago
- ☆23Dec 28, 2024Updated last year
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆13Dec 15, 2024Updated last year
- ☆12Dec 14, 2024Updated last year
- A high-performance batch audio transcription tool using nvidia/parakeet-tdt-0.6b-v2 to generate accurate, well-segmented SRT subtitles, w…☆18Dec 9, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Feb 20, 2026Updated 5 months ago
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- Cross-platform, local-first RWKV chat built with Flutter for Android, iOS, Windows, macOS, and Linux.☆107Updated this week
- ☆12Dec 21, 2024Updated last year
- ☆24Jan 24, 2026Updated 6 months ago
- RADLADS training code☆46May 7, 2025Updated last year
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated 11 months ago
- RAG SYSTEM FOR RWKV☆54Dec 4, 2024Updated last year
- RWKV-based Text-to-Speech implementation in Rust☆28Oct 14, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Efficient PScan implementation in PyTorch☆17Jan 2, 2024Updated 2 years ago
- The nanoGPT-style implementation of RWKV Language Model - an RNN with GPT-level LLM performance.☆199Nov 9, 2023Updated 2 years ago
- ☆81May 15, 2024Updated 2 years ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆54Dec 23, 2024Updated last year
- Generate subtitle for video using whisper and translate to other language using DeepL☆26Apr 7, 2023Updated 3 years ago
- ☆151Nov 22, 2024Updated last year
- ☆18Jul 15, 2026Updated last week