Alternatives and similar repositories for gguf-tools

Users that are interested in gguf-tools are comparing it to the libraries listed below

• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆195Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 11 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• a1k0n / a1gpt
  throwaway GPT inference
  ☆141Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated 2 years ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆499Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• ml-explore / mlx-c
  C API for MLX
  ☆157Updated last week
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆569Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆248Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆230Updated last year
• cjpais / whisperfile
  ☆62Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆544Updated 6 months ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆348Updated 8 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆569Updated last year
• dorjeduck / llm.mojo
  port of Andrjey Karpathy's llm.c to Mojo
  ☆361Updated 4 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆150Updated 5 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆175Updated 2 years ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated 2 years ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆457Updated 2 years ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆295Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• mlecauchois / micrograd-cuda
  ☆249Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆308Updated 2 years ago
• ScalingIntelligence / tokasaurus
  ☆461Updated last month