Alternatives and similar repositories for GGUF-Tool-Suite

Users that are interested in GGUF-Tool-Suite are comparing it to the libraries listed below

• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆31Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆210Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆80Updated last week
• chigkim / Ollama-MMLU-Pro
  ☆102Updated last month
• theroyallab / YALS
  ☆83Updated this week
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆18Updated last month
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last month
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆59Updated 2 weeks ago
• rombodawg / Easy_training
  ☆51Updated 7 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆147Updated this week
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated 11 months ago
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆24Updated 2 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆83Updated 4 months ago
• ubergarm / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆21Updated last week
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆76Updated 11 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆22Updated 6 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆130Updated 3 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated this week
• kevkid / gguf_gui
  ☆122Updated 11 months ago
• FishiaTee / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated 3 weeks ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated 2 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆28Updated 4 months ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated 5 months ago
• PasiKoodaa / dia
  A TTS model capable of generating ultra-realistic dialogue in one pass.
  ☆31Updated 5 months ago
• boneylizard / Eloquent
  A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.
  ☆38Updated 2 months ago
• stduhpf / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆21Updated 3 weeks ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆66Updated 6 months ago
• qrv0 / llm-ripper
  LLM Ripper is a framework for component extraction (embeddings, attention heads, FFNs), activation capture, functional analysis, and adap…
  ☆45Updated this week