Alternatives and similar repositories for GGUF-Tool-Suite

Users that are interested in GGUF-Tool-Suite are comparing it to the libraries listed below

• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated this week
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆18Updated 2 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆200Updated this week
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 11 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆27Updated 4 months ago
• chigkim / Ollama-MMLU-Pro
  ☆100Updated 3 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆211Updated this week
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆24Updated last month
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated 4 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆133Updated this week
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆44Updated 3 months ago
• theroyallab / YALS
  ☆83Updated this week
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆197Updated last month
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆82Updated 4 months ago
• remichu-ai / gallamaUI
  ☆23Updated 10 months ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆28Updated last week
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆110Updated 2 months ago
• kevkid / gguf_gui
  ☆122Updated 10 months ago
• matteoserva / GraphLLM
  ☆209Updated last week
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆136Updated this week
• thushan / olla
  Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and…
  ☆87Updated last week
• rombodawg / Easy_training
  ☆50Updated 7 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆159Updated 4 months ago
• qrv0 / llm-ripper
  LLM Ripper is a framework for component extraction (embeddings, attention heads, FFNs), activation capture, functional analysis, and adap…
  ☆46Updated last week
• reka-ai / rekaquant
  ☆62Updated 2 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆28Updated last month
• jd-3d / SOLOBench
  ☆133Updated 4 months ago
• rodrigobaron / anthill
  ☆24Updated 7 months ago
• PasiKoodaa / Chat-with-Screen
  ☆20Updated 11 months ago