Alternatives and similar repositories for llmi

Users that are interested in llmi are comparing it to the libraries listed below

• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆12Updated 7 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated last month
• cocktailpeanut / hallucinator
  ☆51Updated last year
• Jay4242 / llm-websearch
  My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.
  ☆39Updated 10 months ago
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆38Updated 2 years ago
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆38Updated last year
• curvedinf / novel-writer
  Automated LLM novelist
  ☆46Updated last year
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆33Updated 2 months ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆44Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• rodrigobaron / anthill
  ☆24Updated 11 months ago
• hyperfocAIs / Attend
  Attend - to what matters.
  ☆17Updated 10 months ago
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆25Updated 9 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆25Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆54Updated 10 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆12Updated 10 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆112Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆60Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• NachiketGadekar1 / browserllama
  Browser extension that lets you summarize and chat with any webpage using a local LLM of your choice.
  ☆22Updated last year
• remichu-ai / gallamaUI
  ☆23Updated 3 weeks ago
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆36Updated last month
• sshh12 / llm-chat-web-ui
  LLM Chat is an open-source serverless alternative to ChatGPT.
  ☆35Updated last year
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆47Updated last year
• robbiemu / llama-gguf-optimize
  Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.
  ☆17Updated 11 months ago
• revdotcom / reverb-self-hosted
  This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.
  ☆53Updated last year