Alternatives and similar repositories for ggify

Users that are interested in ggify are comparing it to the libraries listed below

• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• QuixiAI / kraken
  ☆66Updated last year
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆89Updated 8 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆180Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆214Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆55Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆93Updated 11 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆116Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆198Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆78Updated 3 weeks ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆52Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆105Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆127Updated 2 years ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆376Updated 11 months ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆47Updated last year
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 11 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆142Updated 10 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• unslothai / unsloth-studio
  Unsloth Studio
  ☆93Updated 3 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆283Updated 11 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated 8 months ago