Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆248Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆146Updated 3 weeks ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆668Updated this week
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆381Updated this week
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆470Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆246Updated 5 months ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆90Updated 8 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆190Updated this week
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆148Updated 5 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 6 months ago
• sozercan / aikit
  🏗️ Fine-tune, build, and deploy open-source LLMs easily!
  ☆466Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆98Updated last week
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆225Updated 7 months ago
• matteoserva / GraphLLM
  ☆207Updated 2 weeks ago
• Yoosu-L / llmapibenchmark
  The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoi…
  ☆36Updated 5 months ago
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 7 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆461Updated last week
• and270 / thinking_effort_processor
  ☆91Updated last month
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆290Updated 8 months ago
• thad0ctor / llama-server-launcher
  ☆104Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆260Updated 5 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆964Updated last week
• zilliztech / mcp-server-milvus
  Model Context Protocol Servers for Milvus
  ☆162Updated 2 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆149Updated 2 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆119Updated 2 weeks ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆260Updated last month
• ModelCloud / GPTQModel
  Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLa…
  ☆713Updated last week
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆269Updated last month
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆90Updated 6 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆583Updated 5 months ago