Alternatives and similar repositories for gguf-tools

Users that are interested in gguf-tools are comparing it to the libraries listed below

• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆170Updated 2 weeks ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆190Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆193Updated 7 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated 11 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆492Updated last year
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆567Updated 2 years ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆57Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆86Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆181Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆516Updated 2 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆221Updated last year
• cjpais / whisperfile
  ☆61Updated last year
• ScalingIntelligence / tokasaurus
  ☆401Updated this week
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆174Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆206Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆140Updated last year
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆523Updated 11 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆124Updated last month
• Cerebras / gigaGPT
  a small code base for training large models
  ☆309Updated 3 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆288Updated last year
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 6 months ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆677Updated this week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆91Updated 10 months ago