Alternatives and similar repositories for open-LLM-server

Users that are interested in open-LLM-server are comparing it to the libraries listed below

• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆219Updated last year
• ausboss / Local-LLM-Langchain
  Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…
  ☆214Updated 2 years ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆62Updated last year
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆334Updated 9 months ago
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• QuangBK / localLLM_guidance
  Local LLM ReAct Agent with Guidance
  ☆158Updated 2 years ago
• juliooa / secondbrain
  Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.
  ☆288Updated 2 years ago
• latent-variable / Real_time_fallacy_detection
  Real-time Fallacy Detection using OpenAI whisper and ChatGPT/LLaMA/Mistral
  ☆115Updated last year
• lhenault / simpleAI
  An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
  ☆332Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• neuml / txtchat
  💭 Build autonomous agents, retrieval augmented generation (RAG) processes and language model powered chat applications
  ☆293Updated 2 months ago
• pikho / ppromptor
  Prompt-Promptor is a python library for automatically generating prompts using LLMs
  ☆75Updated last year
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆71Updated 2 years ago
• noco-ai / spellbook-docker
  AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
  ☆163Updated last year
• lukaesch / crustagi
  CrustAGI is an Task-driven Autonomous Agent experiment written in Rust
  ☆44Updated 2 years ago
• abacaj / replit-3B-inference
  Run inference on replit-3B code instruct model using CPU
  ☆158Updated 2 years ago
• mithril-security / blind_chat
  A fully in-browser privacy solution to make Conversational AI privacy-friendly
  ☆227Updated 9 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆119Updated 7 months ago
• su77ungr / CASALIOY
  ♾️ toolkit for air-gapped LLMs on consumer-grade hardware
  ☆228Updated last year
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆45Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆176Updated last year
• adriacabeza / erudito
  Erudito: Easy API/CLI to ask questions about your documentation
  ☆101Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• paolorechia / learn-langchain
  ☆276Updated 2 years ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆185Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆112Updated 8 months ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆305Updated last year