Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆193Updated last month
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆73Updated 3 weeks ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆140Updated 3 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• reka-ai / rekaquant
  ☆62Updated 3 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆52Updated last month
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆192Updated last year
• xenova / model-explorer
  Browse, search, and visualize ONNX models.
  ☆35Updated 5 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 10 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆149Updated 5 months ago
• FL33TW00D / deCoreML
  Find out why your CoreML model isn't running on the Neural Engine!
  ☆26Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆43Updated this week
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆184Updated 3 weeks ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆97Updated 4 months ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆62Updated this week
• Narsil / hf-chat
  ☆25Updated 10 months ago
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆29Updated last month
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆94Updated 5 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆95Updated 5 months ago
• sekstini / gpupoor
  ☆17Updated 10 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆102Updated 10 months ago
• huggingface / optimum-onnx
  🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
  ☆70Updated last week
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 4 months ago
• fal-ai / flashpack
  High-throughput tensor loading for PyTorch
  ☆105Updated this week
• QuixiAI / grokadamw
  ☆136Updated last year