Alternatives and similar repositories for ggify

Users that are interested in ggify are comparing it to the libraries listed below

• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆101Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆210Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆102Updated last month
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated last month
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆272Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated 11 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆117Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆96Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 4 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆96Updated 3 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆261Updated 7 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆57Updated last year
• unslothai / unsloth-studio
  Unsloth Studio
  ☆110Updated 6 months ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆187Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆37Updated 2 years ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆205Updated last week
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 3 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆122Updated 9 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆178Updated last year
• apeatling / simple-guide-to-mlx-finetuning
  Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.
  ☆97Updated last year