Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• mmwillet / TTS.cpp
  TTS support with GGML
  ☆209Updated 3 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆21Updated 4 months ago
• taylorchu / kokoro-onnx
  ☆26Updated 11 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆49Updated 3 months ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆55Updated last year
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆15Updated last month
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆54Updated last year
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆194Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆41Updated 2 months ago
• fishiatee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆76Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 10 months ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆80Updated 3 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 6 months ago
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆63Updated 2 years ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆52Updated 10 months ago
• chigkim / Ollama-MMLU-Pro
  ☆108Updated 4 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated 2 years ago
• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆127Updated last week
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 6 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆23Updated last year