Alternatives and similar repositories for gguf-docs

Users that are interested in gguf-docs are comparing it to the libraries listed below

• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆129Updated last week
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆102Updated last month
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆100Updated 3 weeks ago
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆271Updated last week
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆145Updated 2 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆484Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆197Updated 3 weeks ago
• matteoserva / GraphLLM
  ☆209Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,111Updated this week
• adobe-research / dynasaur
  Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"
  ☆348Updated 8 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆162Updated last year
• sam-paech / slop-forensics
  ☆261Updated 2 months ago
• adobe-research / NoLiMa
  Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"
  ☆144Updated last month
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆316Updated 5 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,129Updated this week
• NVlabs / Jet-Nemotron
  ☆403Updated last week
• CohleM / lilLM
  A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.
  ☆52Updated 4 months ago
• theroyallab / YALS
  ☆82Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆73Updated last week
• ideaweaver-ai / DeepSeek-Children-Stories-15M-model
  ☆98Updated 2 months ago
• akashjss / sesame-csm
  A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.
  ☆197Updated 3 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆118Updated 9 months ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆159Updated 2 weeks ago
• TesslateAI / Agent-Builder
  ☆170Updated 2 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆202Updated this week
• menloresearch / ReZero
  ☆155Updated 4 months ago
• cpldcpu / MisguidedAttention
  A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information
  ☆439Updated last month
• SlerpE / highCompute.py
  ☆28Updated 2 months ago
• bwasti / btb
  Blue-text Bot AI. Uses Ollama + AppleScript
  ☆50Updated last year
• abhishekkrthakur / chat-ext
  chrome & firefox extension to chat with webpages: local llms
  ☆125Updated 8 months ago