A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
☆94Sep 2, 2023Updated 2 years ago
Alternatives and similar repositories for smolrsrwkv
Users that are interested in smolrsrwkv are comparing it to the libraries listed below
Sorting:
- Bleeding edge low level Rust binding for GGML☆16Jun 26, 2024Updated last year
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 2 years ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆554Feb 12, 2024Updated 2 years ago
- ☆32Mar 30, 2023Updated 2 years ago
- ☆58Apr 6, 2023Updated 2 years ago
- JAX implementations of RWKV☆19Sep 26, 2023Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,564Mar 23, 2025Updated 11 months ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆28Apr 15, 2024Updated last year
- Rust powered background process CLI task manager☆14May 2, 2022Updated 3 years ago
- A collection of LLM token samplers in Rust☆18Nov 9, 2023Updated 2 years ago
- Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset☆31Apr 2, 2023Updated 2 years ago
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 2 years ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆342Jan 10, 2026Updated last month
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆21Mar 16, 2023Updated 2 years ago
- ☆19Dec 31, 2025Updated 2 months ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77Aug 22, 2025Updated 6 months ago
- Simple, minimal and open source static web server that uses no dependencies.☆41Nov 17, 2022Updated 3 years ago
- A converter and basic tester for rwkv onnx☆43Jan 29, 2024Updated 2 years ago
- Chatbot that answers frequently asked questions in French, English, and Tunisian using the Rasa NLU framework and RWKV-4-Raven☆13May 19, 2023Updated 2 years ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Apr 9, 2023Updated 2 years ago
- ☆23Apr 25, 2023Updated 2 years ago
- Llama2 LLM ported to Rust burn☆280Apr 16, 2024Updated last year
- Tools for the LLaMA language model☆12Apr 4, 2023Updated 2 years ago
- A set of tools and libraries for automatically generating and initiating sandboxes for Rust programs☆15Oct 24, 2022Updated 3 years ago
- Ray Tracer written in Rust☆13Nov 22, 2021Updated 4 years ago
- A Rust Library for High-Performance Tensor Exchange with Python☆51Feb 17, 2026Updated 2 weeks ago
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆413Jul 11, 2023Updated 2 years ago
- ☆28Aug 10, 2023Updated 2 years ago
- SoTA Transformers with C-backend for fast inference on your CPU.☆311Dec 9, 2023Updated 2 years ago
- An unofficial implementation of BitNet☆12Mar 22, 2024Updated last year
- ☆13Jun 3, 2023Updated 2 years ago
- Flask server for RWKV☆10Apr 3, 2023Updated 2 years ago
- Matrix implementation using custos☆12Feb 7, 2024Updated 2 years ago
- Rust Automated Theorem Proving library inspired by a text by John Harrison (WIP)☆21May 21, 2025Updated 9 months ago
- ☆13Dec 12, 2023Updated 2 years ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28May 4, 2025Updated 10 months ago
- Ginkgo is a text editor built entirely in Rust. It supports cursor movements, CTRL commands, select vim commands, insert vs. normal modes…☆13Feb 11, 2022Updated 4 years ago
- Bookmark directories for easy directory-hopping in the terminal☆13Sep 10, 2025Updated 5 months ago