Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆294Updated last month
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆184Updated 3 weeks ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆117Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆758Updated this week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆258Updated 9 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆238Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated 2 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆765Updated this week
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆549Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 4 months ago
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆139Updated last month
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆111Updated last year
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆156Updated 4 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆158Updated 3 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆340Updated 5 months ago
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆221Updated 6 months ago
• Yoosu-L / llmapibenchmark
  The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoi…
  ☆62Updated last month
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆310Updated last year
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆165Updated last week
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆943Updated this week
• 01-ai / Yi-Coder
  🌟 Yi-Coder is a series of open-source code language models that delivers state-of-the-art coding performance with fewer than 10 billion …
  ☆436Updated last year
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆218Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆150Updated 5 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last week
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• thad0ctor / llama-server-launcher
  ☆108Updated 2 weeks ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆67Updated this week
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆209Updated 5 months ago