Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
☆306Oct 8, 2026Updated last week
Alternatives and similar repositories for gguf-parser-go
Users that are interested in gguf-parser-go are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LM inference server implementation based on *.cpp.☆292Nov 24, 2025Updated 10 months ago
- Download models from the Ollama library, without Ollama☆154Aug 12, 2026Updated 2 months ago
- A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.☆5,841Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆3,303Updated this week
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆932Oct 10, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,679Updated this week
- Provides a unified interface to detect GPU resources and manages GPU workloads.☆17Updated this week
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆217Jul 17, 2026Updated 3 months ago
- LLM inference in C/C++☆23Oct 4, 2024Updated 2 years ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- 🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.☆20Jul 2, 2025Updated last year
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 8 months ago
- automatically quant GGUF models☆227Dec 23, 2025Updated 9 months ago
- Simple model memory requirements calculator for GGUF☆84Jan 20, 2026Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆24Dec 29, 2025Updated 9 months ago
- Deliver LLMs of GGUF format via Dockerfile.☆16Oct 24, 2024Updated last year
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 2 months ago
- Benchmark structured generation libraries☆31Oct 25, 2024Updated last year
- LLM (v)RAM estimator for GGUF models from huggingface and ollama across various quantisation and context sizes☆13Nov 26, 2025Updated 10 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,990Updated this week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆83Sep 16, 2026Updated last month
- Tensor library for machine learning☆15,494Updated this week
- Browse, search, and visualize ONNX models.☆36May 6, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,340Updated this week
- ☆21Sep 29, 2026Updated 2 weeks ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 10 months ago
- VS Code extension for LLM-assisted code/text completion☆1,544Oct 10, 2026Updated last week
- A refeference of text models that can be used in the AI Horde☆13Sep 1, 2026Updated last month
- ☆18Jul 1, 2025Updated last year
- ☆21Sep 22, 2025Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated 2 years ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A go wrapper around the rwkv.cpp library☆20Mar 4, 2024Updated 2 years ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆315Aug 27, 2026Updated last month
- GGUF implementation in C as a library and a tools CLI program☆369May 16, 2026Updated 5 months ago
- ☆139Nov 9, 2024Updated last year
- d.run website☆18Updated this week
- Stable Diffusion inference in pure C++☆67Dec 23, 2022Updated 3 years ago
- AI Assistant☆21Feb 21, 2026Updated 7 months ago