Alternatives and similar repositories for gguf-tools:

Users that are interested in gguf-tools are comparing it to the libraries listed below

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆183Updated 11 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 6 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆676Updated last week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated 7 months ago
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆562Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆176Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆136Updated 4 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆133Updated this week
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆148Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆104Updated this week
• ggml-org / p1
  LLM-based code completion engine
  ☆178Updated last week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 4 months ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆476Updated 11 months ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆475Updated 5 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆430Updated 4 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆127Updated 6 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆153Updated 6 months ago
• symisc / tiny-dream
  Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation
  ☆257Updated last year
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆113Updated 6 months ago
• apple / ml-recurrent-drafter
  ☆192Updated last week
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆131Updated 6 months ago
• ml-explore / mlx-c
  C API for MLX
  ☆91Updated this week
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆263Updated 5 months ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆312Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year