Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆180Updated last week
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆127Updated 4 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆191Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆69Updated last year
• menloresearch / cortex.llamacpp
  cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…
  ☆42Updated 2 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 7 months ago
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆34Updated 4 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆176Updated 3 weeks ago
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆53Updated last month
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 8 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆110Updated 2 months ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆69Updated 2 weeks ago
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆18Updated 2 weeks ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆88Updated 3 months ago
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆28Updated last week
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated 10 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 2 months ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 6 months ago
• IST-DASLab / gptq-gguf-toolkit
  DASLab support for GGUF
  ☆37Updated this week
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last week
• huggingface / optimum-onnx
  🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
  ☆43Updated this week
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆95Updated 10 months ago
• 99991 / pygguf
  GGUF parser in Python
  ☆28Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆131Updated last week
• Narsil / whispering
  ☆19Updated this week