Alternatives and similar repositories for binary-mlc-llm-libs:

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆97Updated 8 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆305Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆231Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated last week
• mlc-ai / relax
  ☆157Updated this week
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆150Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆122Updated last year
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆261Updated 5 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆94Updated 2 weeks ago
• Cornell-RelaxML / quip-sharp
  ☆529Updated 5 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆628Updated last year
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆164Updated 3 weeks ago
• ZTMIDGO / RWKV-Android
  使用Android cpu 运行 RWKV V4 ONNX
  ☆70Updated last year
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆225Updated 2 weeks ago
• mlc-ai / llm-perf-bench
  ☆116Updated 11 months ago
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆630Updated last week
• shubham0204 / SmolChat-Android
  Running any GGUF SLMs/LLMs locally, on-device in Android
  ☆232Updated last week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆72Updated 4 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆85Updated 7 months ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,492Updated last week
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆683Updated 7 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• UbiquitousLearning / PhoneLM
  ☆55Updated 4 months ago
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆51Updated last year
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆70Updated 11 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆453Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆112Updated last year