Alternatives and similar repositories for GGUF-Tool-Suite

Users that are interested in GGUF-Tool-Suite are comparing it to the libraries listed below

• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆154Updated this week
• theroyallab / YALS
  ☆90Updated last month
• ubergarm / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆21Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆88Updated last week
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆28Updated last week
• boneylizard / Eloquent
  The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…
  ☆52Updated last week
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆30Updated 8 months ago
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• jim-plus / llm-abliteration
  Make abliterated models with transformers, easy and fast
  ☆115Updated last week
• k-koehler / gguf-tensor-overrider
  ☆51Updated 3 months ago
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆92Updated this week
• mattjamo / OllamaToGGUF
  Convert downloaded Ollama models back into their GGUF equivalent format
  ☆71Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆622Updated last week
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆51Updated 5 months ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆49Updated this week
• conanhujinming / text_dedup
  High-Performance Text Deduplication Toolkit
  ☆61Updated 5 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆68Updated 10 months ago
• SuriyaaMM / feather
  Lower Precision Floating Point Operations
  ☆65Updated 3 weeks ago
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆17Updated 8 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆64Updated 5 months ago
• ReisCook / Voice_Extractor
  Automated speech dataset creator
  ☆215Updated 7 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆126Updated 2 months ago
• matteoserva / GraphLLM
  ☆209Updated 3 weeks ago
• AuleTechnologies / Aule-Attention
  High-performance FlashAttention-2 for AMD, Intel, and Apple GPUs. Drop-in replacement for PyTorch SDPA. Triton backend for ROCm (MI300X, …
  ☆146Updated last week
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆149Updated last month
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆76Updated 10 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆218Updated 5 months ago