Docs for GGUF quantization (unofficial)
☆522Jul 19, 2025Updated last year
Alternatives and similar repositories for gguf-docs
Users that are interested in gguf-docs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluation framework for GGUF☆15Apr 2, 2026Updated 6 months ago
- Evaluating practical performance of local multi-turn conversational LLMs.☆20Aug 1, 2025Updated last year
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆26Sep 1, 2025Updated last year
- llama.cpp fork with additional SOTA quants and improved performance☆3,274Updated this week
- ☆18Jul 1, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- A simple, easy-to-customize pipeline for local RAG evaluation. Starter prompts and metric definitions included.☆23Jan 14, 2026Updated 8 months ago
- A user-friendly GUI for llama.cpp — convert, quantize, and run GGUF models without touching the terminal.☆25Jun 9, 2026Updated 3 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆170Sep 11, 2026Updated 3 weeks ago
- ☆16Jul 23, 2026Updated 2 months ago
- Writing Tools, Apple's AI-inspired app, enchants Windows, enhancing your pen with AI LLMs. One hotkey press, system-wide, fixes grammar, …☆33Sep 14, 2026Updated 3 weeks ago
- ☆1,974Updated this week
- ☆19Oct 18, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- High-Performance Text Deduplication Toolkit☆60Aug 25, 2025Updated last year
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆304Updated this week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,828Updated this week
- ☆43Feb 25, 2026Updated 7 months ago
- LLM inference in C/C++☆130,285Updated this week
- Mirror from gitlab☆11Jan 9, 2021Updated 5 years ago
- Thin wrapper around GGML to make life easier☆48Jul 26, 2026Updated 2 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,583Updated this week
- A llama.cpp simple wrapper in Swift☆18Nov 9, 2025Updated 10 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- DiT model quantizer for ComfyUI. Converts full-precision models to NVFP4/FP8 using comfy-kitchen☆24Jul 14, 2026Updated 2 months ago
- A collection of LLM token samplers in Rust☆18Nov 9, 2023Updated 2 years ago
- This is a repository for collaboration on vision-based robot navigation.☆12Jul 28, 2022Updated 4 years ago
- Local-first agent runtime for MCP workflows with explicit trust controls, replayable runs, and built-in evals.☆31Aug 15, 2026Updated last month
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆54Oct 29, 2025Updated 11 months ago
- Neural Audio Codecs implemented in C# - DAC, SNAC, Encodec, Dia☆48Jun 11, 2025Updated last year
- ☆341May 15, 2026Updated 4 months ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆77,197Updated this week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆179Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Zoof is a high-efficiency Small Language Model (SLM) engineered from scratch. It demonstrates how modern architectural choices and high-q…☆48Jan 13, 2026Updated 8 months ago
- Tensor library for machine learning☆15,442Sep 24, 2026Updated last week
- TRELLIS.2 image-to-3D in C++/GGML (CUDA + Vulkan), with a resident HTTP server☆329Sep 25, 2026Updated last week
- Enhancing LLMs with LoRA☆227Oct 20, 2025Updated 11 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,455Sep 28, 2026Updated last week
- BROKEN REPO. DO NOT USE UNDER ANY CIRCUMSTANCES☆20Sep 28, 2026Updated last week
- ☆36Feb 2, 2026Updated 8 months ago