Alternatives and similar repositories for ggml

Users that are interested in ggml are comparing it to the libraries listed below

• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 5 months ago
• louis030195 / remember
  record everything you see and hear using Brilliant Monocle. Open Source x rewind.ai x Semantic x AR/XR
  ☆11Updated last year
• kyegomez / Pegasus
  PegasusX: The Future of Multimodal Embeddings 🦄 🦄
  ☆14Updated 9 months ago
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆23Updated this week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆174Updated last month
• adrienbrault / json-schema-to-gbnf
  Converts JSON-Schema to GBNF grammar to use with llama.cpp
  ☆55Updated last year
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆38Updated last year
• lucasavila00 / LmScript
  Controllable Language Model Interactions in TypeScript
  ☆9Updated last year
• EndoTheDev / OllaMoMa
  Easily explore, manage, and interact with your local Ollama models.
  ☆12Updated last year
• openempathic / EMNS-DCT
  ☆14Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆49Updated 2 months ago
• replicate / cog-mpt-7b-storywriter-65k
  A cog implementation of MosaicML's MPT-7B-StoryWriter-65k+ Large Language Model
  ☆57Updated 2 years ago
• kafischer / AIMindFlow
  The first AI artist
  ☆32Updated 2 years ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆73Updated 5 months ago
• lablab-ai / webgpu-llm-chrome-extension-starter
  WebLLM Chrome Extension Starter Pack.
  ☆12Updated 2 years ago
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆11Updated 2 months ago
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆90Updated last month
• raidendotai / clone-interpreter
  Code Interpreter Replica
  ☆24Updated 2 years ago
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆50Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆44Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated 2 years ago
• nomic-ai / cookbook
  examples and guides to using Nomic Atlas
  ☆39Updated 3 months ago
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆19Updated last year
• simonw / scrape-openai-code-interpreter
  Scrape details about Code Interpreter to track any changes
  ☆67Updated 3 months ago
• h43lb1t0 / KokoroTtsTexGernerationWebui
  An extension to use Kokoro TTS in text generation webui
  ☆21Updated 3 months ago
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 11 months ago
• jcosta33 / client-llm-vite
  ☆45Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated last year
• pinokiocomputer / pinokiod
  Backend for https://github.com/pinokiocomputer/pinokio
  ☆58Updated last week