Alternatives and similar repositories for cortex.llamacpp:

Users that are interested in cortex.llamacpp are comparing it to the libraries listed below

• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆13Updated 2 weeks ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 7 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated 4 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆56Updated 2 months ago
• RichardKelley / hflm
  A simple library for working with Hugging Face models.
  ☆14Updated 3 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆33Updated 9 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated 9 months ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 2 months ago
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 8 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆86Updated 8 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 8 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• nishchaljs / MobiRAG
  ☆22Updated this week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆16Updated 7 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆30Updated last week
• AlexBodner / How_Much_VRAM
  ☆100Updated 7 months ago
• Mozilla-Ocho / llamafile-llamaindex-examples
  ☆19Updated 11 months ago
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆56Updated last year
• not-nullptr / Spotllama
  Spotlight-like client for Ollama on Windows.
  ☆27Updated 11 months ago
• taylorchu / kokoro-onnx
  ☆17Updated 2 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated this week
• cjpais / whisperfile
  ☆54Updated 8 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 4 months ago
• deepgrove-ai / Bonsai
  ☆19Updated last month
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year