Alternatives and similar repositories for ggify

Users that are interested in ggify are comparing it to the libraries listed below

• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆116Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated 3 weeks ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆265Updated 8 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated 2 weeks ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆119Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆106Updated 3 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 4 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆377Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated 2 years ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆78Updated this week
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• QuixiAI / OpenChatML
  ☆163Updated 3 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆160Updated 2 years ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆118Updated last year
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆282Updated 5 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆116Updated 7 months ago
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆111Updated last year
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆84Updated 3 weeks ago