Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆226Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆124Updated 2 weeks ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆86Updated 7 months ago
• and270 / thinking_effort_processor
  ☆90Updated 3 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆608Updated this week
• thad0ctor / llama-server-launcher
  ☆96Updated last week
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆247Updated this week
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆44Updated last week
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆144Updated 4 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆236Updated 3 months ago
• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆138Updated this week
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 11 months ago
• matteoserva / GraphLLM
  ☆204Updated last month
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆634Updated this week
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆302Updated 3 weeks ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆111Updated last week
• drazdra / ollama-chats
  Ollama chat client in Vue, everything you need to do your private text rpg in browser
  ☆133Updated 8 months ago
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆382Updated last month
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• amanvirparhar / weebo
  A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.
  ☆230Updated 5 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 9 months ago
• ModelCloud / GPTQModel
  Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLa…
  ☆633Updated this week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆96Updated 2 weeks ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆449Updated this week
• Yoosu-L / llmapibenchmark
  The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoi…
  ☆27Updated 4 months ago