Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 6 months ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆36Updated 3 weeks ago
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆15Updated last week
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 9 months ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆51Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• taylorchu / kokoro-onnx
  ☆21Updated 5 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 11 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆188Updated 10 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆127Updated 2 weeks ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 2 weeks ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆43Updated last month
• futo-org / whisper-acft
  ☆146Updated last year
• znfgnu / easy-agent
  Simple agent framework using Ollama tool calling
  ☆10Updated 10 months ago
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆76Updated last month
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 10 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated 8 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆36Updated 11 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆95Updated 2 weeks ago
• rodrigobaron / anthill
  ☆24Updated 5 months ago
• wavify-labs / wavify-sdks
  fast state-of-the-art speech models and a runtime that runs anywhere 💥
  ☆55Updated last month
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆25Updated 2 months ago
• TAR-ALEX / llm-html
  ☆17Updated last week
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆20Updated 9 months ago