Alternatives and similar repositories for rwkv-mobile

Users that are interested in rwkv-mobile are comparing it to the libraries listed below

• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆87Updated 3 weeks ago
• daquexian / faster-rwkv
  ☆124Updated last year
• EdVince / diffusers-ncnn
  ☆83Updated 2 years ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆48Updated last year
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆80Updated last year
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• EdVince / llm-cpp
  ☆33Updated last year
• Joluck / RWKV-PEFT
  ☆153Updated 2 weeks ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆46Updated last year
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated 2 years ago
• Sg4Dylan / libvits-ncnn
  libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻
  ☆62Updated 2 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated 3 weeks ago
• MollySophia / rwkv-ncnn
  Infere RWKV on NCNN
  ☆49Updated last year
• casper-hansen / AutoAWQ_kernels
  ☆78Updated 11 months ago
• futz12 / ncnn_llm
  A repo for llm on ncnn
  ☆33Updated last week
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆54Updated 3 months ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆236Updated last week
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆70Updated 2 years ago
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆13Updated last year
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆23Updated 7 months ago
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆86Updated last year
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆132Updated 3 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆180Updated 7 months ago
• EdVince / GPT2-ChineseChat-NCNN
  GPT2⚡NCNN⚡中文对话⚡x86⚡Android
  ☆81Updated 3 years ago
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆108Updated this week
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆130Updated last year