antirez / gguf-toolsLinks
GGUF implementation in C as a library and a tools CLI program
☆270Updated 4 months ago
Alternatives and similar repositories for gguf-tools
Users that are interested in gguf-tools are comparing it to the libraries listed below
Sorting:
- Inference of Mamba models in pure C☆186Updated last year
- throwaway GPT inference☆139Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆143Updated 3 weeks ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 9 months ago
- WebGPU LLM inference tuned by hand☆150Updated last year
- LLaVA server (llama.cpp).☆179Updated last year
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆764Updated last week
- A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…☆127Updated 10 months ago
- LLM-based code completion engine☆188Updated 4 months ago
- Python bindings for ggml☆140Updated 9 months ago
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆567Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆137Updated 10 months ago
- ggml implementation of BERT☆492Updated last year
- SoTA Transformers with C-backend for fast inference on your CPU.☆308Updated last year
- ☆157Updated 10 months ago
- Heirarchical Navigable Small Worlds☆96Updated last month
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆54Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- Transformer GPU VRAM estimator☆64Updated last year
- ☆55Updated 9 months ago
- CLIP inference in plain C/C++ with no extra dependencies☆498Updated 9 months ago
- a small code base for training large models☆299Updated last month
- Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation☆261Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- Run GGML models with Kubernetes.☆172Updated last year
- ☆192Updated last month
- ☆116Updated 4 months ago