Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolchain will create a GGUF recipe tuned to your system within seconds — flexible model sizing and lowest achievable perplexity/kld for advanced users seeking precise and automated GGUF dynamic quant production.
☆86Mar 25, 2026Updated this week
Alternatives and similar repositories for GGUF-Tool-Suite
Users that are interested in GGUF-Tool-Suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A minimal CLI tool for piping anything into an LLM.☆20Jan 1, 2026Updated 2 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆701Updated this week
- ☆54Oct 10, 2025Updated 5 months ago
- Esobold - A fork of KoboldCPP with agent schenanigans and server side saving!☆24Mar 22, 2026Updated last week
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆25Sep 1, 2025Updated 6 months ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- ☆32Jul 20, 2024Updated last year
- A collection python tools used to create gguf files and upload to huggingface☆17Updated this week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆86Updated this week
- Loader extension for tabbyAPI in SillyTavern☆26Jun 30, 2025Updated 8 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆164Mar 12, 2026Updated 2 weeks ago
- HDM model loader for ComfyUI☆41Dec 14, 2025Updated 3 months ago
- Extension for Forge-based UIs (Forge, reForge, etc) and ComfyUI to replace CFG with Negative Rejection Steering☆16Feb 14, 2026Updated last month
- ☆19Jul 4, 2025Updated 8 months ago
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆26Nov 5, 2024Updated last year
- Port of Facebook's LLaMA model in C/C++☆13Updated this week
- Make YouTube videos readable. Local-first Markdown summaries with Ollama, with cloud providers support.☆63Dec 28, 2025Updated 3 months ago
- ☆73Jun 20, 2025Updated 9 months ago
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- The easiest & fastest way to run LLMs in your home lab☆87Feb 23, 2026Updated last month
- Thank you LenAnderson I am yoinking this!☆24Jan 13, 2026Updated 2 months ago
- ☆31Dec 6, 2025Updated 3 months ago
- Find the hidden meaning of LLMs☆40Nov 13, 2025Updated 4 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Mar 22, 2026Updated last week
- A web-app to explore topics using LLM (less typing and more clicks)☆68Mar 15, 2026Updated 2 weeks ago
- ☆64Jul 10, 2025Updated 8 months ago
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆29Dec 29, 2025Updated 3 months ago
- Learn faster with the power of AI☆17Mar 23, 2026Updated last week
- A rework of the gradio WebUI for the open-source unified multimodal model by ByteDance☆22Jun 3, 2025Updated 9 months ago
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 3 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,895Updated this week
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆50Oct 29, 2025Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Port of Alex's Mobs to Fabric. Has some changes for Crimecraft S3, so don't expect this to be 1:1.☆14Dec 15, 2025Updated 3 months ago
- Multichannel Looper/Feedback System for Riffusion☆14May 6, 2023Updated 2 years ago
- An insanely secure password manager.☆17Mar 10, 2026Updated 2 weeks ago
- ☆28Jan 2, 2026Updated 2 months ago
- AI in A Box☆25Feb 23, 2026Updated last month
- Ultimate Persona is an all-in-one persona generator and plot hook creator for SillyTavern. It uses pre-existing character cards to shape …☆30Dec 30, 2025Updated 2 months ago
- Qwen LLM in the mac menu bar <3☆27Mar 12, 2025Updated last year