antirez / gguf-tools
GGUF implementation in C as a library and a tools CLI program
☆263Updated 2 months ago
Alternatives and similar repositories for gguf-tools:
Users that are interested in gguf-tools are comparing it to the libraries listed below
- An implementation of bucketMul LLM inference☆216Updated 9 months ago
- Inference of Mamba models in pure C☆187Updated last year
- LLM-based code completion engine☆181Updated 2 months ago
- Python bindings for ggml☆140Updated 7 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆128Updated this week
- throwaway GPT inference☆140Updated 10 months ago
- A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…☆125Updated 8 months ago
- WebGPU LLM inference tuned by hand☆149Updated last year
- LLaVA server (llama.cpp).☆179Updated last year
- ☆152Updated 8 months ago
- ggml implementation of BERT☆486Updated last year
- Port of Meta's Encodec in C/C++☆216Updated 3 months ago
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆735Updated 2 weeks ago
- CLIP inference in plain C/C++ with no extra dependencies☆487Updated 7 months ago
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆566Updated last year
- Run GGML models with Kubernetes.☆174Updated last year
- Stable Diffusion in pure C/C++☆60Updated last year
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- llama.cpp fork with additional SOTA quants and improved performance☆231Updated this week
- Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation☆257Updated last year
- SoTA Transformers with C-backend for fast inference on your CPU.☆311Updated last year
- ☆253Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆135Updated 8 months ago
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- ☆163Updated 10 months ago
- ☆242Updated last year
- Web browser version of StarCoder.cpp☆44Updated last year
- C API for MLX☆102Updated this week
- FlashAttention (Metal Port)☆465Updated 6 months ago
- GGML implementation of BERT model with Python bindings and quantization.☆56Updated last year