A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
☆94Sep 2, 2023Updated 2 years ago
Alternatives and similar repositories for smolrsrwkv
Users that are interested in smolrsrwkv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bleeding edge low level Rust binding for GGML☆17Jun 26, 2024Updated last year
- ☆32Mar 30, 2023Updated 3 years ago
- ☆35Apr 8, 2023Updated 3 years ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆20Sep 25, 2023Updated 2 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆21Mar 16, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆554Feb 12, 2024Updated 2 years ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆28Apr 15, 2024Updated 2 years ago
- RWKV models and examples powered by candle.☆24Jan 19, 2026Updated 4 months ago
- ☆58Apr 6, 2023Updated 3 years ago
- A collection of LLM token samplers in Rust☆18Nov 9, 2023Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,569Mar 23, 2025Updated last year
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago
- Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset☆31Apr 2, 2023Updated 3 years ago
- call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)☆36Feb 21, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of the RWKV language model in pure WebGPU/Rust.☆352Apr 1, 2026Updated last month
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated 11 months ago
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77May 13, 2026Updated 2 weeks ago
- Node.js implementation binding for the RWKV.cpp module☆21Aug 2, 2023Updated 2 years ago
- RWKV centralised docs for the community☆34Jan 17, 2026Updated 4 months ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆413Jul 11, 2023Updated 2 years ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆312Jan 31, 2024Updated 2 years ago
- An unofficial implementation of BitNet☆12Mar 22, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- Simple channel-like APIs over TCP streams for communications between rust services.☆39Jun 22, 2024Updated last year
- A simple, hackable magnet url parser in Rust☆20May 9, 2025Updated last year
- ☆19Dec 31, 2025Updated 4 months ago
- Enhancing LangChain prompts to work better with RWKV models☆34May 30, 2023Updated 3 years ago
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,147Jun 24, 2024Updated last year
- RWKV model implementation☆37Jul 15, 2023Updated 2 years ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28May 4, 2025Updated last year
- Flexible plugin for Logseq that annotates deadline/schedule times with a countdown or time difference☆18Mar 22, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- libopus transpiled to rust by c2rust☆19Nov 21, 2024Updated last year
- Simple, minimal and open source static web server that uses no dependencies.☆41Nov 17, 2022Updated 3 years ago
- Llama2 LLM ported to Rust burn☆280Apr 16, 2024Updated 2 years ago
- A fast RWKV Tokenizer written in Rust☆54Aug 12, 2025Updated 9 months ago
- ☆24Apr 25, 2023Updated 3 years ago
- Web browser version of StarCoder.cpp☆47Jul 30, 2023Updated 2 years ago
- Nondestructive editing of various formats☆15Nov 1, 2025Updated 6 months ago