Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆311Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆123Updated last year
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆631Updated 2 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated 9 months ago
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆102Updated last month
• mlc-ai / llm-perf-bench
  ☆119Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆492Updated last year
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆245Updated this week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆167Updated last week
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆86Updated 10 months ago
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆207Updated 4 months ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,523Updated 2 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆452Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆614Updated last week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆495Updated 4 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• mlc-ai / relax
  ☆157Updated this week
• cognitivecomputations / OpenChatML
  ☆157Updated 10 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆130Updated 11 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆300Updated 2 years ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆152Updated last year
• Cornell-RelaxML / quip-sharp
  ☆536Updated 7 months ago
• microsoft / WizardLM2
  ☆59Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆245Updated last year
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆121Updated last year
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆142Updated last week
• ggml-org / p1
  LLM-based code completion engine
  ☆188Updated 4 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 8 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆181Updated this week