Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 7 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 4 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 5 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆12Updated 9 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆47Updated 7 months ago
• taylorchu / kokoro-onnx
  ☆19Updated 3 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆35Updated this week
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆13Updated last week
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated 10 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆94Updated last month
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆25Updated last week
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆48Updated 10 months ago
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 2 months ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆29Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆61Updated this week
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆15Updated 8 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated last week
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆38Updated 3 weeks ago
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated last month
• Nero10578 / LLM-Inference-Benchmark
  ☆14Updated 8 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• CalvesGEH / VoiceCraftAPI
  An API for VoiceCraft.
  ☆25Updated 10 months ago
• wavify-labs / wavify-sdks
  fast state-of-the-art speech models and a runtime that runs anywhere 💥
  ☆55Updated 3 months ago
• deepgrove-ai / Bonsai
  ☆19Updated last month