Alternatives and similar repositories for gguf-tools

Users that are interested in gguf-tools are comparing it to the libraries listed below

• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆194Updated 5 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆156Updated last month
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆180Updated last year
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆782Updated this week
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆128Updated 11 months ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆493Updated last year
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆567Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated 9 months ago
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated last year
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• AMD-AIG-AIMA / AMD-LLM
  ☆187Updated 9 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆453Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆214Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆301Updated last month
• cjpais / whisperfile
  ☆57Updated 10 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆137Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• carsonpo / haystackdb
  ☆163Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated 2 months ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆377Updated 2 weeks ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆193Updated 11 months ago
• mlecauchois / micrograd-cuda
  ☆248Updated last year
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆22Updated 6 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year