Alternatives and similar repositories for web-rwkv

Users that are interested in web-rwkv are comparing it to the libraries listed below

• Ai00-X / ai00_server
  The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
  ☆590Updated last month
• Prunoideae / web-rwkv-axum
  A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.
  ☆28Updated last year
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆313Updated last year
• Joluck / RWKV-PEFT
  ☆157Updated 2 weeks ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆235Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆540Updated this week
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,555Updated 8 months ago
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆94Updated 2 years ago
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆147Updated last year
• nkypy / candle-rwkv
  RWKV models and examples powered by candle.
  ☆19Updated 9 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆105Updated 6 months ago
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆551Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆196Updated last year
• cryscan / web-rwkv-inspector
  ☆13Updated 11 months ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆413Updated 2 years ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆725Updated last year
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆408Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆198Updated 2 months ago
• utilityai / llama-cpp-rs
  ☆407Updated this week
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated 2 years ago
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆55Updated 2 months ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆231Updated 5 months ago
• AIIRWKV / RWKV-RAG
  RAG SYSTEM FOR RWKV
  ☆51Updated last year
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆208Updated 3 weeks ago
• Triang-jyed-driung / RWKV-World-Finetune
  Fine-tuning RWKV-World model
  ☆26Updated 2 years ago
• second-state / gpt_sovits_rs
  ☆33Updated 3 months ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆500Updated last year