Alternatives and similar repositories for cortex.cpp

Users that are interested in cortex.cpp are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Fast, flexible LLM inference
  ☆6,449Updated last week
• janhq / awesome-local-ai
  An awesome repository of local AI tools
  ☆1,828Updated last year
• andrewnguonly / Lumos
  A RAG LLM co-pilot for browsing the web, powered by local LLMs
  ☆1,514Updated last year
• jacoblee93 / fully-local-pdf-chatbot
  Yes, it's another chat over documents implementation... but this one is entirely local!
  ☆1,818Updated 2 months ago
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,295Updated this week
• abi / secret-llama
  Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
  ☆2,678Updated last year
• ex3ndr / llama-coder
  Replace Copilot local AI
  ☆2,084Updated last year
• alexpinel / Dot
  Text-To-Speech, RAG, and LLMs. All local!
  ☆1,894Updated last year
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆987Updated last month
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,406Updated last year
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,154Updated last week
• BruceMacD / chatd
  Chat with your documents using local AI
  ☆1,075Updated last year
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,815Updated 2 weeks ago
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,964Updated last month
• louisgv / local.ai
  🎒 local.ai - Run AI locally on your PC!
  ☆718Updated 2 years ago
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,430Updated 3 weeks ago
• a-real-ai / pywinassistant
  The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user…
  ☆1,326Updated 11 months ago
• lmstudio-ai / model-catalog
  A collection of standardized JSON descriptors for Large Language Model (LLM) files.
  ☆799Updated last year
• lmstudio-ai / lmstudio-js
  LM Studio TypeScript SDK
  ☆1,479Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,431Updated last month
• semanser / codel
  ✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.
  ☆2,437Updated last year
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,590Updated 2 months ago
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,062Updated last year
• FL33TW00D / whisper-turbo
  Cross-Platform, GPU Accelerated Whisper 🏎️
  ☆1,803Updated last year
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,641Updated 2 weeks ago
• srikanth235 / privy
  An open-source alternative to GitHub copilot that runs locally.
  ☆992Updated last year
• ggozad / oterm
  the terminal client for Ollama
  ☆2,313Updated last month
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,325Updated last year
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,787Updated last year
• janhq / ichigo
  Local realtime voice AI
  ☆2,425Updated 2 months ago