Alternatives and similar repositories for cortex.llamacpp

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 9 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 6 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆35Updated 3 weeks ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated 11 months ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆117Updated last week
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆40Updated 3 weeks ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• taylorchu / kokoro-onnx
  ☆21Updated 4 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆86Updated this week
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated this week
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 6 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• yukiarimo / hanasu
  Hanasu is a human-like TTS model based on the multilingual Himitsu V1 transformer-based encoder and VITS architecture
  ☆30Updated 2 weeks ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• cjpais / whisperfile
  ☆57Updated 10 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆187Updated 10 months ago
• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆87Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• Shubin123 / kokorojs
  kokoro text to speech using javascript
  ☆58Updated 4 months ago
• Mobile-Artificial-Intelligence / babylon.cpp
  Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port…
  ☆21Updated 9 months ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆41Updated 9 months ago
• RobViren / kvoicewalk
  A random walk voice style cloning application for Kokoro text to speech
  ☆99Updated last week
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year