Alternatives and similar repositories for gguf-parser-go

Users that are interested in gguf-parser-go are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆185Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆109Updated 3 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆439Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆253Updated 2 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆583Updated last week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆76Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆174Updated last week
• matteoserva / GraphLLM
  ☆202Updated 3 weeks ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 9 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆36Updated last week
• and270 / thinking_effort_processor
  ☆88Updated 2 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆226Updated 2 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆217Updated 4 months ago
• ModelCloud / GPTQModel
  Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLa…
  ☆537Updated this week
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆135Updated last month
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆180Updated 3 months ago
• MindWorkAI / AI-Studio
  AI Studio is an independent app for utilizing LLM.
  ☆259Updated last week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆165Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆341Updated this week
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆745Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆89Updated 4 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated 10 months ago
• moxin-org / Moxin-LLM
  Moxin is a family of fully open-source and reproducible LLMs
  ☆92Updated 2 weeks ago
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆56Updated last year
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆52Updated 2 weeks ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆558Updated 2 months ago
• microsoft / WizardLM2
  ☆59Updated last year
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆72Updated 5 months ago
• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆48Updated last week
• amanvirparhar / weebo
  A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.
  ☆224Updated 3 months ago