Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
☆253Mar 25, 2026Updated this week
Alternatives and similar repositories for gguf-parser-go
Users that are interested in gguf-parser-go are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.☆4,704Updated this week
- Rancher Prime GC Catalog☆13Mar 6, 2026Updated 3 weeks ago
- LLM inference in C/C++☆23Oct 4, 2024Updated last year
- 🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.☆20Jul 2, 2025Updated 8 months ago
- automatically quant GGUF models☆221Dec 23, 2025Updated 3 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated 2 years ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,895Updated this week
- /j f t/ - YAML file tool☆13Feb 9, 2026Updated last month
- LLama.cpp golang bindings☆879Feb 3, 2026Updated last month
- ☆17Feb 12, 2026Updated last month
- a cli/mcp server tool for managing mcp server json config file with version control, profiles and multi-client support☆10Feb 24, 2025Updated last year
- AI Assistant☆20Feb 21, 2026Updated last month
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆29May 6, 2025Updated 10 months ago
- C# ONNX Runtime SDK - Text, Image, Video and Audio supported☆19Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆86Updated this week
- AirLLM 70B inference with single 4GB GPU☆20Jun 27, 2025Updated 9 months ago
- A fuzzy finder with GUI (inspired by fzf)☆14Oct 29, 2020Updated 5 years ago
- llama.cpp gguf file parser for javascript☆50Dec 11, 2024Updated last year
- A wrapper shard for llama.cpp that acts as a client to work directly with AI models through llama.cpp from within Crystal applications☆19Jan 23, 2025Updated last year
- Standalone, local-runnable binaries of popular linux distributions☆10Dec 15, 2021Updated 4 years ago
- Jinja2 chat templates for popular LLM models☆45Jun 21, 2024Updated last year
- Vaak is a AI Enabled Dictation keyboard. In Punjabi Vaak Refers to Utterance or Speech.☆24Oct 9, 2025Updated 5 months ago
- Package alg provides access to Linux AF_ALG sockets for communication with the Linux kernel crypto API. MIT Licensed.☆16May 11, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Inference RWKV v7 in pure C.☆44Oct 10, 2025Updated 5 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- OpenPipe Reinforcement Learning Experiments☆32Mar 14, 2025Updated last year
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆12Aug 31, 2023Updated 2 years ago
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆847Updated this week
- ☆24Jan 22, 2025Updated last year
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆18Updated this week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆86Updated this week
- MindWork AI Studio is a free, independent cross-platform desktop app for local and cloud LLMs across providers, built to democratize AI a…☆431Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- An MCP Server to enable global access to Rememberizer☆35Jul 29, 2025Updated 8 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆55Aug 21, 2025Updated 7 months ago
- Browse, search, and visualize ONNX models.☆34May 6, 2025Updated 10 months ago
- d.run website☆17Mar 13, 2026Updated 2 weeks ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,024Dec 17, 2025Updated 3 months ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆31May 1, 2025Updated 10 months ago
- Android本地运行mnn-llm语言模型简单示例☆13Oct 2, 2025Updated 5 months ago