Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆295Updated 2 months ago
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆192Updated last month
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆123Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆798Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆261Updated 11 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆582Updated this week
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆169Updated 5 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆161Updated 5 months ago
• and270 / thinking_effort_processor
  ☆94Updated 7 months ago
• Yoosu-L / llmapibenchmark
  The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoi…
  ☆68Updated 3 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated last year
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆232Updated 2 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆239Updated last year
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆156Updated this week
• thad0ctor / llama-server-launcher
  ☆108Updated 2 weeks ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆843Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆366Updated 6 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆333Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,605Updated this week
• micytao / vllm-playground
  A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…
  ☆366Updated this week
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆73Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 2 weeks ago
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆282Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆167Updated last year
• matteoserva / GraphLLM
  ☆209Updated last month
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆170Updated 9 months ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆220Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆626Updated 2 weeks ago