Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆276Updated last month
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆162Updated 2 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆713Updated last week
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 8 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆252Updated 7 months ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆100Updated 10 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆498Updated last week
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆152Updated 3 weeks ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆195Updated 2 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,220Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆203Updated last week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated last month
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆131Updated last month
• kaito-project / aikit
  🏗️ Fine-tune, build, and deploy open-source LLMs easily!
  ☆478Updated this week
• MindWorkAI / AI-Studio
  AI Studio is an independent app for utilizing LLMs.
  ☆305Updated last week
• thad0ctor / llama-server-launcher
  ☆105Updated last week
• Yoosu-L / llmapibenchmark
  The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoi…
  ☆42Updated 3 weeks ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆297Updated 10 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆229Updated 9 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆295Updated last month
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆214Updated 3 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆212Updated this week
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆279Updated last month
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆160Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆101Updated last month
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆92Updated 3 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆267Updated 2 months ago
• matteoserva / GraphLLM
  ☆209Updated 3 weeks ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated this week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆592Updated 7 months ago