dcSpark-AI / open-LLM-server
Run local LLMs via HTTP API in a single command (Windows/Mac/Linux)
☆61Updated last year
Alternatives and similar repositories for open-LLM-server:
Users that are interested in open-LLM-server are comparing it to the libraries listed below
- Local LLM ReAct Agent with Guidance☆155Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- A guidance language for controlling large language models.☆44Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆55Updated last year
- Long-Term Chat: ChatGPT with memory that makes conversations more fun and personal.☆55Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆73Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆176Updated last year
- A fast batching API to serve LLM models☆177Updated 8 months ago
- Real-time Fallacy Detection using OpenAI whisper and ChatGPT/LLaMA/Mistral☆110Updated last year
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆35Updated last year
- Experimental LLM Inference UX to aid in creative writing☆111Updated last month
- Prompt-Promptor is a python library for automatically generating prompts using LLMs☆72Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆72Updated last year
- A langchain based tool to allow agents to dynamically create, use, store, and retrieve tools to solve real world problems☆124Updated last year
- OpenAI compatible API for serving LLAMA-2 model☆215Updated last year
- Easily create LLM automation/agent workflows☆58Updated 11 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- CrustAGI is an Task-driven Autonomous Agent experiment written in Rust☆43Updated last year
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆43Updated 11 months ago
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆68Updated last year
- Discord chatbot interface to train an LLM on user message history☆27Updated last year
- ☆218Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆104Updated 2 months ago
- Porting BabyAGI to Oobabooba.☆33Updated last year
- Haystack and Mistral 7B RAG Implementation. It is based on completely open-source stack.☆79Updated last year
- A prompt/context management system☆167Updated last year
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆153Updated last month
- This plugin forces models to output JSON of a specified schema using JSONFormer☆26Updated 2 months ago
- ☆45Updated 8 months ago