Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆187Updated 2 weeks ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆191Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆180Updated this week
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆69Updated last week
• huggingface / optimum-onnx
  🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
  ☆53Updated this week
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆142Updated 4 months ago
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆130Updated 3 months ago
• IST-DASLab / gptq-gguf-toolkit
  GPTQ and efficient search for GGUF
  ☆50Updated 3 weeks ago
• deepgrove-ai / Bonsai
  ☆30Updated 6 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last month
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 9 months ago
• reka-ai / rekaquant
  ☆62Updated 2 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 9 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆190Updated last year
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆34Updated 5 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆90Updated 4 months ago
• zanussbaum / surfgrad
  webgpu autograd library
  ☆32Updated 4 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 3 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆95Updated 3 months ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆52Updated 7 months ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• Narsil / whispering
  ☆20Updated last week
• kyutai-labs / dactory
  ☆43Updated last week
• ml-explore / mlx-c
  C API for MLX
  ☆134Updated last week