Alternatives and similar repositories for gguf-tools:

Users that are interested in gguf-tools are comparing it to the libraries listed below

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆185Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆123Updated last week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated 9 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆181Updated last month
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 6 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆565Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆713Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆172Updated this week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆482Updated last year
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆121Updated 7 months ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆87Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆177Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆98Updated this week
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆27Updated 11 months ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆255Updated last month
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 7 months ago
• dorjeduck / llm.mojo
  port of Andrjey Karpathy's llm.c to Mojo
  ☆352Updated 2 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆439Updated 5 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆287Updated 2 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆174Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆126Updated 3 months ago
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆82Updated 5 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆86Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆129Updated 7 months ago