Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
☆245Feb 11, 2026Updated 3 weeks ago
Alternatives and similar repositories for gguf-parser-go
Users that are interested in gguf-parser-go are comparing it to the libraries listed below
Sorting:
- LM inference server implementation based on *.cpp.☆296Nov 24, 2025Updated 3 months ago
- Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.☆4,573Updated this week
- LLM inference in C/C++☆23Oct 4, 2024Updated last year
- Rancher Prime GC Catalog☆13Updated this week
- 🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.☆20Jul 2, 2025Updated 8 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated last year
- automatically quant GGUF models☆220Dec 23, 2025Updated 2 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,696Updated this week
- Vaak is a AI Enabled Dictation keyboard. In Punjabi Vaak Refers to Utterance or Speech.☆23Oct 9, 2025Updated 4 months ago
- Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp☆170Apr 29, 2025Updated 10 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆79Feb 22, 2026Updated last week
- ☆15Feb 12, 2026Updated 3 weeks ago
- ☆24Jan 22, 2025Updated last year
- LLama.cpp golang bindings☆877Feb 3, 2026Updated last month
- ☆130Nov 9, 2024Updated last year
- a cli/mcp server tool for managing mcp server json config file with version control, profiles and multi-client support☆10Feb 24, 2025Updated last year
- 📦 Go library that enables your users to submit error reports to GitHub☆13Aug 8, 2024Updated last year
- Go as a shader language: converts Go code to SPIR-V via HLSL☆11Jan 9, 2024Updated 2 years ago
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆16Feb 10, 2026Updated 3 weeks ago
- ☆15Apr 9, 2025Updated 10 months ago
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- C# ONNX Runtime SDK - Text, Image, Video and Audio supported☆19Feb 18, 2026Updated 2 weeks ago
- Visual Tagger is a JavaScript tool that visually highlights HTML elements for AIs, aiding in identifying interactive components on web pa…☆11Oct 28, 2024Updated last year
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆18Jan 10, 2025Updated last year
- A Go implementation of the HOTP (RFC 4226) and TOTP (RFC 6238) algorithms.☆21Feb 28, 2026Updated last week
- The Kotlin wrapper of llama.cpp, powered by JNA☆13Aug 8, 2023Updated 2 years ago
- d.run website☆15Feb 26, 2026Updated last week
- Browse, search, and visualize ONNX models.☆34May 6, 2025Updated 10 months ago
- AirLLM 70B inference with single 4GB GPU☆17Jun 27, 2025Updated 8 months ago
- A C++ implementation of tinyllama inference on CPU.☆12Feb 28, 2024Updated 2 years ago
- Testing KAN-based text generation GPT models☆18May 6, 2024Updated last year
- Open source Speechify alternative. Read PDFs and EPUBs with local models.☆37Nov 14, 2025Updated 3 months ago
- A refeference of text models that can be used in the AI Horde☆13Updated this week
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆22Aug 5, 2025Updated 7 months ago
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙 Alternative to projects like llm-d, Docker Model R…☆1,474Updated this week
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆17Feb 22, 2026Updated last week
- ☆18Aug 19, 2025Updated 6 months ago
- A C++ formatting proposal that has not been widely acknowledged☆18Jul 17, 2024Updated last year
- KVDB☆38Oct 10, 2025Updated 4 months ago