antirez / gguf-toolsLinks
GGUF implementation in C as a library and a tools CLI program
☆292Updated last month
Alternatives and similar repositories for gguf-tools
Users that are interested in gguf-tools are comparing it to the libraries listed below
Sorting:
- LLM-based code completion engine☆191Updated 8 months ago
- Inference of Mamba models in pure C☆192Updated last year
- Python bindings for ggml☆146Updated last year
- throwaway GPT inference☆140Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆187Updated 2 weeks ago
- ggml implementation of BERT☆493Updated last year
- An implementation of bucketMul LLM inference☆223Updated last year
- A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…☆138Updated last year
- CLIP inference in plain C/C++ with no extra dependencies☆522Updated 3 months ago
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆568Updated 2 years ago
- LLaVA server (llama.cpp).☆182Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆223Updated last year
- C API for MLX☆134Updated last week
- ☆426Updated last month
- ☆60Updated last year
- SoTA Transformers with C-backend for fast inference on your CPU.☆307Updated last year
- Mistral7B playing DOOM☆137Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆248Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆118Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆55Updated last year
- Run GGML models with Kubernetes.☆174Updated last year
- Heirarchical Navigable Small Worlds☆101Updated last month
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- C++ implementation for 💫StarCoder☆457Updated 2 years ago
- llama.cpp to PyTorch Converter☆34Updated last year
- ☆254Updated 2 years ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆296Updated last year
- a small code base for training large models☆308Updated 5 months ago
- port of Andrjey Karpathy's llm.c to Mojo☆357Updated 2 months ago
- FlashAttention (Metal Port)☆538Updated last year