Alternatives and similar repositories for gguf-tools

Users that are interested in gguf-tools are comparing it to the libraries listed below

• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆203Updated 4 months ago
• kroggen / mamba.c
  Inference of Mamba and Mamba2 models in pure C
  ☆196Updated 2 weeks ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆224Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆147Updated last year
• a1k0n / a1gpt
  throwaway GPT inference
  ☆141Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆150Updated 2 years ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆498Updated last year
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆569Updated 2 years ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆143Updated 3 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated 2 years ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆322Updated 9 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆139Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆172Updated last week
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆175Updated 2 years ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated 2 years ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆552Updated 7 months ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated 2 years ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated 2 years ago
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆37Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆29Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆246Updated last year
• ScalingIntelligence / tokasaurus
  ☆466Updated 2 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆141Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆157Updated 7 months ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 11 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆459Updated 2 years ago