Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 5 months ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 8 months ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆34Updated this week
• taylorchu / kokoro-onnx
  ☆21Updated 4 months ago
• rodrigobaron / anthill
  ☆24Updated 4 months ago
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆13Updated this week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• nishchaljs / MobiRAG
  ☆29Updated last month
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆13Updated 9 months ago
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆15Updated 9 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆39Updated this week
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 6 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• cocktailpeanut / deeperhermes
  deep hermes, but decides how to respond based on its OWN decision, no need for system prompts.
  ☆36Updated 2 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆34Updated 10 months ago
• revdotcom / reverb-self-hosted
  This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.
  ☆52Updated 5 months ago
• anjor / ollama-mcp-client
  ☆58Updated 5 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆24Updated last month
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 3 months ago
• Mobile-Artificial-Intelligence / babylon.cpp
  Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port…
  ☆21Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆65Updated this week
• navedmerchant / JotItNow
  JotItNow is a AI Voice Notes App
  ☆15Updated 3 months ago
• FFengIll / embedding.cpp
  ggml implementation of BERT Embedding
  ☆25Updated last year
• lucasavila00 / LmScript
  Controllable Language Model Interactions in TypeScript
  ☆9Updated last year
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 2 months ago
• rupeshs / shortgpt
  Ask shortgpt for instant and concise answers
  ☆13Updated 2 years ago
• NebuLlamaUI / NebuLlamaUI
  An interface that features barely zero external dependencies beyond the Ollama API itself, making it lightweight and portable to easily i…
  ☆12Updated 2 months ago
• ggml-org / ci
  CI for ggml and related projects
  ☆29Updated this week