Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆233Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆134Updated last week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆656Updated this week
• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆206Updated this week
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆89Updated 8 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆146Updated 5 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆461Updated last week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆188Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 5 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆242Updated 4 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆116Updated 2 weeks ago
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆257Updated 4 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆155Updated last year
• and270 / thinking_effort_processor
  ☆90Updated last week
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆257Updated 3 weeks ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆219Updated 7 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆176Updated 2 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆45Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆652Updated this week
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆58Updated last year
• matteoserva / GraphLLM
  ☆204Updated last month
• thad0ctor / llama-server-launcher
  ☆101Updated this week
• bodaay / HuggingFaceModelDownloader
  Simple go utility to download HuggingFace Models and Datasets
  ☆697Updated 8 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆146Updated 2 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆312Updated 3 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆255Updated 2 weeks ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆100Updated last month
• amanvirparhar / weebo
  A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.
  ☆232Updated 5 months ago