Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆197Updated last month
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆73Updated last month
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆192Updated last year
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆35Updated 6 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆98Updated 6 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆149Updated 6 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• reka-ai / rekaquant
  ☆62Updated 4 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆193Updated last month
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆145Updated 4 months ago
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆29Updated 2 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆53Updated 2 months ago
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆17Updated 2 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 4 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆44Updated 3 weeks ago
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 10 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆178Updated this week
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 8 months ago
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆54Updated 3 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆72Updated 9 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated last year
• kroggen / mamba-cpu
  Modified Mamba code to run on CPU
  ☆30Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• deepgrove-ai / Bonsai
  ☆33Updated 7 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆122Updated 9 months ago