Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.
☆141Jun 23, 2026Updated 2 weeks ago
Alternatives and similar repositories for GGUF-Tool-Suite
Users that are interested in GGUF-Tool-Suite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama.cpp fork with additional SOTA quants and improved performance☆22Updated this week
- Esobold - A fork of KoboldCPP with agent schenanigans and server side saving!☆43Updated this week
- A minimal CLI tool for piping anything into an LLM.☆21Jan 1, 2026Updated 6 months ago
- ☆57Oct 10, 2025Updated 8 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆176Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆25Sep 1, 2025Updated 10 months ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- llama.cpp fork with additional SOTA quants and improved performance☆2,846Updated this week
- ☆32Jul 20, 2024Updated last year
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- A cross platform App that gives you the best UX to run models locally or remotely on your own hardware☆82Mar 22, 2026Updated 3 months ago
- An image editor server and iOS app☆25Jan 10, 2026Updated 5 months ago
- Extension for Forge-based UIs (Forge, reForge, etc) and ComfyUI to replace CFG with Negative Rejection Steering☆16May 16, 2026Updated last month
- HDM model loader for ComfyUI☆41Dec 14, 2025Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated 11 months ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆78Dec 17, 2024Updated last year
- Port of Facebook's LLaMA model in C/C++☆13Jun 30, 2026Updated last week
- Make YouTube videos readable. Local-first Markdown summaries with Ollama, with cloud providers support.☆64Jun 8, 2026Updated last month
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆155Updated this week
- An unsupervised model merging algorithm for Transformers-based language models.☆108Apr 29, 2024Updated 2 years ago
- ☆18Jul 12, 2025Updated 11 months ago
- ☆32Nov 5, 2024Updated last year
- Advanced interoperability middleware for GPGPU acceleration. Facilitates cross vendor hardware abstraction and API translation for parall…☆96May 23, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆82Jun 20, 2025Updated last year
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- Thank you LenAnderson I am yoinking this!☆30May 3, 2026Updated 2 months ago
- Orchestrator Kit for Agentic Reasoning - OrKa is a modular AI orchestration system that transforms Large Language Models (LLMs) into comp…☆93Updated this week
- automatically quant GGUF models☆227Dec 23, 2025Updated 6 months ago
- A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.☆190Mar 23, 2026Updated 3 months ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 3 weeks ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Mar 15, 2026Updated 3 months ago
- Learn faster with the power of AI☆17Jun 14, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 7 months ago
- Sparse Inferencing for transformer based LLMs☆219Mar 25, 2026Updated 3 months ago
- Kiwix ZIM-to-vector RAG system for local, offline LLM knowledge retrieval☆29Mar 24, 2026Updated 3 months ago
- ☆63Jul 10, 2025Updated 11 months ago
- ☆25Oct 13, 2025Updated 8 months ago
- ☆41Apr 19, 2026Updated 2 months ago
- Port of Alex's Mobs to Fabric. Has some changes for Crimecraft S3, so don't expect this to be 1:1.☆13Dec 15, 2025Updated 6 months ago