Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• mmwillet / TTS.cpp
  TTS support with GGML
  ☆147Updated last week
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 8 months ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆53Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆43Updated 2 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆187Updated last year
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆15Updated last week
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF with the smallest (0.6B) at the fullest (FP32)
  ☆16Updated 2 weeks ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆40Updated 2 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 2 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆95Updated last week
• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆121Updated 3 weeks ago
• rodrigobaron / anthill
  ☆24Updated 7 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆73Updated last week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆265Updated 3 weeks ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆57Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆96Updated last month
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆102Updated last month
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆49Updated 3 months ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆86Updated last year
• taylorchu / kokoro-onnx
  ☆22Updated 7 months ago
• not-nullptr / Spotllama
  Spotlight-like client for Ollama on Windows.
  ☆28Updated last year
• RobViren / kvoicewalk
  A random walk voice style cloning application for Kokoro text to speech
  ☆121Updated 2 months ago
• FFengIll / embedding.cpp
  ggml implementation of BERT Embedding
  ☆26Updated last year
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆28Updated 3 months ago
• Milimo-Quantum / milimochat
  MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…
  ☆14Updated 5 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆38Updated last year