Alternatives and similar repositories for ggml-easy

Users that are interested in ggml-easy are comparing it to the libraries listed below

• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• lucasnewman / vocos-mlx
  Implementation of 'Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis', in MLX
  ☆19Updated 7 months ago
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆27Updated 7 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆115Updated 3 weeks ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆21Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• deepgrove-ai / Bonsai
  ☆19Updated 2 months ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆23Updated 2 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 5 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 11 months ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆19Updated 3 months ago
• slashml / awesome-finetuning
  ☆28Updated 9 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆13Updated 9 months ago
• EQ-bench / Judgemark-v2
  ☆15Updated 4 months ago
• menloresearch / cortex.llamacpp
  cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…
  ☆40Updated this week
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆34Updated 3 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆61Updated 4 months ago
• huggingface / ember
  ANE accelerated embedding models!
  ☆17Updated 5 months ago
• FL33TW00D / deCoreML
  Find out why your CoreML model isn't running on the Neural Engine!
  ☆25Updated 11 months ago
• argmaxinc / SDBench
  Open-source and reproducible benchmarks for Speaker Diarization
  ☆26Updated last month
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆153Updated 3 weeks ago
• nyxkrage / ebook-groupchat
  ☆9Updated last year
• huggingface / leaderboards
  ☆18Updated 2 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆67Updated 11 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 11 months ago