gpustack / gguf-parser-goLinks
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
☆227Updated last week
Alternatives and similar repositories for gguf-parser-go
Users that are interested in gguf-parser-go are comparing it to the libraries listed below
Sorting:
- LM inference server implementation based on *.cpp.☆294Updated last month
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆187Updated 3 weeks ago
- Download models from the Ollama library, without Ollama☆119Updated last year
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆763Updated this week
- A proxy server for multiple ollama instances with Key security☆561Updated 2 months ago
- run DeepSeek-R1 GGUFs on KTransformers☆259Updated 10 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 11 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,494Updated this week
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆321Updated 2 weeks ago
- Comparison of Language Model Inference Engines☆238Updated last year
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆799Updated this week
- InferX: Inference as a Service Platform☆146Updated this week
- The Fastest Way to Fine-Tune LLMs Locally☆332Updated 3 weeks ago
- automatically quant GGUF models☆219Updated 3 weeks ago
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆150Updated 6 months ago
- Library for model distillation☆160Updated 4 months ago
- Fully-featured, beautiful web interface for vLLM - built with NextJS.☆170Updated last month
- ☆210Updated last week
- 🏗️ Fine-tune, build, and deploy open-source LLMs easily!☆503Updated this week
- LLM inference in C/C++☆104Updated last month
- No-code CLI designed for accelerating ONNX workflows☆224Updated 7 months ago
- Simple go utility to download HuggingFace Models and Datasets☆802Updated 2 weeks ago
- ☆108Updated 4 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆616Updated last week
- ☆94Updated 6 months ago
- Code execution utilities for Open WebUI & Ollama☆313Updated last year
- The main repository for building Pascal-compatible versions of ML applications and libraries.☆160Updated 4 months ago
- ☆69Updated this week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆609Updated 10 months ago
- xllamacpp - a Python wrapper of llama.cpp☆68Updated 2 weeks ago