A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
☆95Sep 2, 2023Updated 2 years ago
Alternatives and similar repositories for smolrsrwkv
Users that are interested in smolrsrwkv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bleeding edge low level Rust binding for GGML☆18Jun 26, 2024Updated 2 years ago
- ☆32Mar 30, 2023Updated 3 years ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆20Sep 25, 2023Updated 2 years ago
- A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.☆30Apr 15, 2024Updated 2 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆21Mar 16, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆554Feb 12, 2024Updated 2 years ago
- ☆58Apr 6, 2023Updated 3 years ago
- A collection of LLM token samplers in Rust☆18Nov 9, 2023Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,581Mar 23, 2025Updated last year
- JAX implementations of RWKV☆18Sep 26, 2023Updated 2 years ago
- A go wrapper around the rwkv.cpp library☆20Mar 4, 2024Updated 2 years ago
- A converter and basic tester for rwkv onnx☆44Jan 29, 2024Updated 2 years ago
- call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)☆36Feb 21, 2025Updated last year
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago
- Download full or partial git-lfs repos without temporarily using 2x disk space☆32Oct 13, 2023Updated 2 years ago
- Low effort scraping Python's pickle format in Rust. It is to complete pickle parsing as BeautifulSoup was to complete HTML parsing.☆27May 25, 2024Updated 2 years ago
- ☆28Aug 10, 2023Updated 2 years ago
- A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.☆77Jul 2, 2026Updated 3 weeks ago
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- Node.js implementation binding for the RWKV.cpp module☆22Aug 2, 2023Updated 2 years ago
- An unofficial implementation of BitNet☆12Mar 22, 2024Updated 2 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆412Jul 11, 2023Updated 3 years ago
- 一个基于Flask实现的RWKV_Role_Playing项目的API。☆32Jun 26, 2024Updated 2 years ago
- A simple, hackable magnet url parser in Rust☆20May 9, 2025Updated last year
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆313Jan 31, 2024Updated 2 years ago
- ☆17Aug 1, 2023Updated 2 years ago
- ☆19Dec 31, 2025Updated 6 months ago
- Yet another LLM☆10Apr 6, 2023Updated 3 years ago
- [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models☆6,154Jun 24, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Flexible plugin for Logseq that annotates deadline/schedule times with a countdown or time difference☆19Mar 22, 2023Updated 3 years ago
- Simple, minimal and open source static web server that uses no dependencies.☆41Nov 17, 2022Updated 3 years ago
- Fine-tuning RWKV-World model☆26Jun 6, 2023Updated 3 years ago
- Nondestructive editing of various formats☆16May 26, 2026Updated 2 months ago
- Llama2 LLM ported to Rust burn☆280Apr 16, 2024Updated 2 years ago
- Neural Language Model for Go☆62Jun 30, 2023Updated 3 years ago
- A fast RWKV Tokenizer written in Rust☆53Updated this week