Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆293Updated last week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆177Updated 4 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆749Updated this week
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆115Updated last year
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆540Updated 3 weeks ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆257Updated 9 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆730Updated this week
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆913Updated this week
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆158Updated 2 months ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆153Updated 3 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• and270 / thinking_effort_processor
  ☆94Updated 4 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆141Updated this week
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆236Updated 11 months ago
• thad0ctor / llama-server-launcher
  ☆107Updated this week
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆309Updated last year
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆314Updated 2 months ago
• chigkim / Ollama-MMLU-Pro
  ☆108Updated 3 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆206Updated 4 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated last week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆254Updated this week
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆91Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆218Updated last year
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆108Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,358Updated this week
• intel / auto-round
  Advanced quantization toolkit for LLMs and VLMs. Native support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Bits and seamless integration with …
  ☆735Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆324Updated 4 months ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆163Updated last year
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆326Updated 8 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆146Updated 5 months ago