Alternatives and similar repositories for binary-mlc-llm-libs:

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆303Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆94Updated 6 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆117Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆184Updated 2 weeks ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated 9 months ago
• OpenBMB / mlc-MiniCPM
  MiniCPM on Android platform.
  ☆625Updated 10 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 4 months ago
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆265Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆154Updated this week
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆146Updated last year
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 4 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆183Updated 11 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆64Updated 4 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆155Updated this week
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆224Updated 6 months ago
• mlc-ai / llm-perf-bench
  ☆117Updated 10 months ago
• Cornell-RelaxML / quip-sharp
  ☆527Updated 3 months ago
• yynil / RWKVinLLAMA
  ☆18Updated last month
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆254Updated 6 months ago
• microsoft / WizardLM2
  ☆60Updated 10 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆14Updated this week
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• OpenBMB / LLMFarm-MiniCPM
  MiniCPM on iOS.
  ☆65Updated 8 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆145Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆514Updated this week
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆145Updated 11 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆620Updated 11 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year