Alternatives and similar repositories for cortex.llamacpp:

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 4 months ago
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆12Updated this week
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆40Updated 3 weeks ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆31Updated 6 months ago
• hexgrad / misaki
  G2P
  ☆35Updated this week
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated last month
• mateogon / pdf-narrator
  Convert your PDFs into audiobooks effortlessly. Features intelligent text extraction, customizable text-to-speech settings, and efficient…
  ☆37Updated 2 weeks ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆54Updated 9 months ago
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆34Updated last week
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated 11 months ago
• perk11 / large-model-proxy
  Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…
  ☆49Updated 3 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆17Updated 3 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆52Updated 9 months ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆44Updated 4 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆12Updated 5 months ago
• bdytx5 / open_answer_engine
  ☆21Updated 5 months ago
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 6 months ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆108Updated 7 months ago
• nomic-ai / llama.cpp
  Nomic Vulkan Fork of LLaMa.cpp
  ☆51Updated this week
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 3 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆65Updated 7 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 5 months ago
• teknium1 / ShareGPT-Builder
  ☆109Updated last month
• beyondExp / B-Llama3-o
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆26Updated 7 months ago
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆23Updated 3 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆133Updated this week
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆93Updated 3 months ago
• blazickjp / arxiv-mcp-server
  A Model Context Protocol server for searching and analyzing arXiv papers
  ☆52Updated this week