Alternatives and similar repositories for web-rwkv

Users that are interested in web-rwkv are comparing it to the libraries listed below

• Ai00-X / ai00_server
  The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
  ☆597Updated 3 months ago
• Prunoideae / web-rwkv-axum
  A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.
  ☆28Updated last year
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆313Updated 2 years ago
• Joluck / RWKV-PEFT
  ☆171Updated 3 weeks ago
• nkypy / candle-rwkv
  RWKV models and examples powered by candle.
  ☆24Updated 3 weeks ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆241Updated last year
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆554Updated last year
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,562Updated 10 months ago
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated last year
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆94Updated 2 years ago
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆591Updated last week
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• Triang-jyed-driung / RWKV-World-Finetune
  Fine-tuning RWKV-World model
  ☆26Updated 2 years ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆108Updated 8 months ago
• kroggen / mamba.c
  Inference of Mamba and Mamba2 models in pure C
  ☆196Updated 2 weeks ago
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆414Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated 2 years ago
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆77Updated this week
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆62Updated 4 months ago
• mrsteyk / rwkvk-rs
  ☆32Updated 2 years ago
• cryscan / web-rwkv-inspector
  ☆13Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆498Updated last year
• lucasjinreal / Crane
  A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …
  ☆244Updated last week
• Abel2076 / json2binidx_tool
  ☆81Updated last year
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆234Updated 8 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆147Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆744Updated last year
• shoumenchougou / Awesome-RWKV-Prompts
  用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.
  ☆35Updated last year