🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
☆33Jun 10, 2025Updated last year
Alternatives and similar repositories for llm-server
Users that are interested in llm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RAG Chatbot powered by Groq LPU, Ollama and Langchain☆13Mar 5, 2024Updated 2 years ago
- Integrated LLM-based document and data Q&A with knowledge graph visualization☆24Dec 9, 2023Updated 2 years ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated 10 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆31Jul 19, 2025Updated last year
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆48Jun 9, 2025Updated last year
- A CLI tool you can pipe code and then ask for changes, add documentation, etc, using the OpenAI API.☆13Jan 5, 2024Updated 2 years ago
- Building AI Research Assistant: Multi-Agent RAG System Reading From Multiple Unstructured Sources☆23Jul 15, 2024Updated 2 years ago
- A reusable leave-behind for enterprise customers showing the differentiator of using the best Vector Store in the world: Astra DB☆22Feb 2, 2024Updated 2 years ago
- Obrew Server: A self-hostable machine learning engine. Build agents and schedule workflows private to you.☆17May 16, 2026Updated 3 months ago
- ☆15Sep 13, 2024Updated last year
- This repository contains a toy implementation of a basic RAQA system.☆21Jun 3, 2024Updated 2 years ago
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆25Updated this week
- LLM Chat is an open-source serverless alternative to ChatGPT.☆36Sep 13, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆70Nov 17, 2025Updated 9 months ago
- Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3☆25May 22, 2024Updated 2 years ago
- A plugin for hapi.js that generates etags for your responses☆10Jul 22, 2018Updated 8 years ago
- My implementation of autogen and memgpt agents that work together to create simple scripts and help plan out larger projects.☆30Jan 28, 2024Updated 2 years ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆17Dec 22, 2025Updated 8 months ago
- Stateful AI Agent for Knowledge Extraction☆20Dec 21, 2025Updated 8 months ago
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- Implementation of Corrective RAG using LangChain and LangGraph.☆29May 13, 2026Updated 3 months ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Agentis is an application interface for your local AI models with Ollama allowing you to speak with text and voice with your LLM.☆17Jan 23, 2024Updated 2 years ago
- ☆14Sep 18, 2024Updated last year
- Lightweight, secure and login like console display manager for X☆16Nov 1, 2021Updated 4 years ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- SEO Suggestions from GPT using Keyword Ranking based on search volume, CPC and paid competition.☆12Jun 28, 2023Updated 3 years ago
- stream-of-consciousness experience of an AI's thinking process, complete with creative tangents and unexpected connections.☆14Jan 29, 2025Updated last year
- 🤖 AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.☆17Jan 14, 2024Updated 2 years ago
- An AI toolkit for performing complex internet lookups, crawls and summaries. It utilizes and constantly expands it's knowledge stores wit…☆22Jul 27, 2024Updated 2 years ago
- Lean immutable wrappers around lodash get/set/update/delete, especially helpful for redux reducers.☆12Apr 24, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- API GPT4 Free☆14Jan 31, 2024Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 3 years ago
- Dabarqus is incredibly fast RAG that runs everywhere.☆61Jan 30, 2025Updated last year
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year
- A dual-chatbot system for learning languages based on LangChain☆14Jun 25, 2023Updated 3 years ago
- A fusion of AI agents and the AARRR framework, pushing the frontiers of Growth Marketing☆14Aug 22, 2023Updated 3 years ago