Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
☆310Oct 30, 2026Updated last week
Alternatives and similar repositories for gguf-parser-go
Users that are interested in gguf-parser-go are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LM inference server implementation based on *.cpp.☆291Nov 24, 2025Updated 11 months ago
- Download models from the Ollama library, without Ollama☆154Aug 12, 2026Updated 2 months ago
- A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.☆5,983Updated this week
- A simple python-based terminal tool to manage llama.cpp☆13Sep 30, 2025Updated last year
- Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp☆193Apr 29, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆940Oct 27, 2026Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆3,377Updated this week
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,689Updated this week
- Kuu — minimal native macOS terminal (SwiftUI + libghostty)☆16Oct 29, 2026Updated last week
- automatically quant GGUF models☆227Dec 23, 2025Updated 10 months ago
- Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don…☆6,180Updated this week
- LLM inference in C/C++☆23Oct 4, 2024Updated 2 years ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 8 months ago
- 🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.☆20Jul 2, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Simple model memory requirements calculator for GGUF☆84Jan 20, 2026Updated 9 months ago
- Lua bindings for gemma.cpp☆12Oct 30, 2025Updated last year
- GGUF implementation in C as a library and a tools CLI program☆373May 16, 2026Updated 5 months ago
- A simple, yet highly customisable DPadView for Android.☆12Mar 18, 2020Updated 6 years ago
- Tensor library for machine learning☆15,586Updated this week
- Some random tools for working with the GGUF file format☆33Nov 24, 2023Updated 2 years ago
- GPU Power and Performance Manager☆73Oct 13, 2024Updated 2 years ago
- CLI utility to inspect and explore .safetensors and .gguf files☆66Jun 20, 2026Updated 4 months ago
- a GGUF file parser☆25Aug 31, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Editor with LLM generation tree exploration☆88Feb 12, 2025Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- VS Code extension for LLM-assisted code/text completion☆1,551Updated this week
- Node.js proxy server for debugging OpenAI-compatible chat completions requests.☆10Nov 20, 2025Updated 11 months ago
- LLama.cpp golang bindings☆945Oct 10, 2026Updated 3 weeks ago
- ☆18Jul 1, 2025Updated last year
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 11 months ago
- A refeference of text models that can be used in the AI Horde☆13Oct 20, 2026Updated 2 weeks ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A go wrapper around the rwkv.cpp library☆20Mar 4, 2024Updated 2 years ago
- 本项目旨在解决Qwen3-Reranker-0.6B模型无法通过Vllm平台直接部署的问题。☆13Jul 8, 2025Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,363Updated this week
- Geometric Algebra Calculators - quaternions, octonions, sedenions and Clifford algebra☆12Sep 25, 2026Updated last month
- Файлы русской локализации Fear & Hunger 2: Termina☆11Sep 11, 2026Updated last month
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆315Aug 27, 2026Updated 2 months ago
- ROCm distrobox/Docker environment for image & video generation (Qwen Image/Edit, WAN 2.2, LTX-2, ComfyUI) on AMD Strix Halo / gfx1151☆11Aug 4, 2026Updated 3 months ago