Alternatives and similar repositories for ggify

Users that are interested in ggify are comparing it to the libraries listed below

• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆90Updated 8 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆98Updated last week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆190Updated this week
• unslothai / unsloth-studio
  Unsloth Studio
  ☆98Updated 4 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 7 months ago
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆271Updated 11 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆217Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆56Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆260Updated 5 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆94Updated last year
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆376Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆47Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆139Updated last week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆181Updated last year
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆342Updated this week
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆52Updated last year
• QuixiAI / OpenChatML
  ☆157Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆128Updated 2 years ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated 2 years ago
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆144Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆204Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆143Updated 11 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆116Updated last year
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆22Updated last year
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆44Updated last year