A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
☆94Sep 2, 2023Updated 2 years ago
Alternatives and similar repositories for smolrsrwkv
Users that are interested in smolrsrwkv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bleeding edge low level Rust binding for GGML☆17Jun 26, 2024Updated last year
- ☆32Mar 30, 2023Updated 3 years ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆20Sep 25, 2023Updated 2 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆21Mar 16, 2023Updated 3 years ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆554Feb 12, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆29Apr 15, 2024Updated 2 years ago
- JAX implementations of RWKV☆18Sep 26, 2023Updated 2 years ago
- RWKV models and examples powered by candle.☆24Jan 19, 2026Updated 5 months ago
- ☆58Apr 6, 2023Updated 3 years ago
- A collection of LLM token samplers in Rust☆18Nov 9, 2023Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,572Mar 23, 2025Updated last year
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 2 years ago
- A converter and basic tester for rwkv onnx☆44Jan 29, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A go wrapper around the rwkv.cpp library☆20Mar 4, 2024Updated 2 years ago
- call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)☆36Feb 21, 2025Updated last year
- Implementation of the RWKV language model in pure WebGPU/Rust.☆354Jun 1, 2026Updated 2 weeks ago
- Rust powered background process CLI task manager☆15May 2, 2022Updated 4 years ago
- Download full or partial git-lfs repos without temporarily using 2x disk space☆32Oct 13, 2023Updated 2 years ago
- RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance☆41Feb 12, 2023Updated 3 years ago
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77May 13, 2026Updated last month
- Node.js implementation binding for the RWKV.cpp module☆22Aug 2, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- RWKV centralised docs for the community☆34Jan 17, 2026Updated 5 months ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆413Jul 11, 2023Updated 2 years ago
- ☆26Jun 10, 2023Updated 3 years ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆312Jan 31, 2024Updated 2 years ago
- An unofficial implementation of BitNet☆12Mar 22, 2024Updated 2 years ago
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- Neural Language Model for Go☆61Jun 30, 2023Updated 2 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- 一个基于Flask实现的RWKV_Role_Playing项目的API。☆32Jun 26, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Simple channel-like APIs over TCP streams for communications between rust services.☆39Jun 22, 2024Updated last year
- A simple, hackable magnet url parser in Rust☆20May 9, 2025Updated last year
- ☆19Dec 31, 2025Updated 5 months ago
- Enhancing LangChain prompts to work better with RWKV models☆34May 30, 2023Updated 3 years ago
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,150Jun 24, 2024Updated last year
- Yet another LLM☆10Apr 6, 2023Updated 3 years ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28May 4, 2025Updated last year