mlc-ai / binary-mlc-llm-libs

Related projects ⓘ

Alternatives and complementary repositories for binary-mlc-llm-libs

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆77Updated 3 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆294Updated 9 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆140Updated this week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆244Updated 9 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• Cornell-RelaxML / quip-sharp
  ☆505Updated 3 weeks ago
• OpenBMB / mlc-MiniCPM
  MiniCPM on Android platform.
  ☆561Updated 7 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆114Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU)
  ☆409Updated this week
• nerve-sparks / iris_android
  Local LLM App
  ☆135Updated last month
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆226Updated last month
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆208Updated last month
• cognitivecomputations / OpenChatML
  ☆149Updated 4 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆100Updated 6 months ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• microsoft / WizardLM2
  ☆61Updated 7 months ago
• Vali-98 / ChatterUI
  Simple frontend for LLMs built in react-native.
  ☆573Updated this week
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆203Updated last month
• AUGMXNT / deccp
  Evaling and unaligning Chinese LLM censorship
  ☆26Updated last month
• OpenBMB / LLMFarm-MiniCPM
  MiniCPM on iOS.
  ☆62Updated 5 months ago
• mlc-ai / llm-perf-bench
  ☆114Updated 7 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆144Updated 11 months ago
• mlc-ai / relax
  ☆152Updated last week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆172Updated 6 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆595Updated 8 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆83Updated this week
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆315Updated 8 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆446Updated last year