Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆150Updated 5 months ago
• AuleTechnologies / Aule-Attention
  High-performance FlashAttention-2 for AMD, Intel, and Apple GPUs. Drop-in replacement for PyTorch SDPA. Triton backend for ROCm (MI300X, …
  ☆122Updated this week
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• deepgrove-ai / Bonsai
  ☆34Updated 9 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆57Updated 3 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated last month
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆34Updated 7 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆153Updated 7 months ago
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆34Updated last year
• fal-ai / flashpack
  High-throughput tensor loading for PyTorch
  ☆213Updated 3 weeks ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆97Updated 7 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆76Updated last year
• reka-ai / rekaquant
  ☆62Updated 5 months ago
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 9 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆104Updated 7 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• fishiatee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆195Updated last year
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆78Updated 2 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 10 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆202Updated 2 months ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• United-Compute / gpu-benchmark
  Benchmark your GPU with ease
  ☆28Updated 7 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆66Updated 6 months ago