🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
☆33Jun 10, 2025Updated 8 months ago
Alternatives and similar repositories for llm-server
Users that are interested in llm-server are comparing it to the libraries listed below
Sorting:
- RAG Chatbot powered by Groq LPU, Ollama and Langchain☆13Mar 5, 2024Updated 2 years ago
- Integrated LLM-based document and data Q&A with knowledge graph visualization☆24Dec 9, 2023Updated 2 years ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆18Dec 22, 2025Updated 2 months ago
- My Gen AI research☆11Jun 3, 2024Updated last year
- Agentis is an application interface for your local AI models with Ollama allowing you to speak with text and voice with your LLM.☆15Jan 23, 2024Updated 2 years ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated 4 months ago
- A reusable leave-behind for enterprise customers showing the differentiator of using the best Vector Store in the world: Astra DB☆21Feb 2, 2024Updated 2 years ago
- An AI toolkit for performing complex internet lookups, crawls and summaries. It utilizes and constantly expands it's knowledge stores wit…☆20Jul 27, 2024Updated last year
- API GPT4 Free☆14Jan 31, 2024Updated 2 years ago
- A lightweight Python API wrapper and CLI for Groq’s offering of language models using their ultra fast LPU Inference Engine.☆23Sep 12, 2024Updated last year
- Retrieval augmented generation demos with open-source DeepSeek, Llama, Qwen, Mistral, Gemma☆42Aug 18, 2025Updated 6 months ago
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆46Jun 9, 2025Updated 8 months ago
- This repository contains a toy implementation of a basic RAQA system.☆20Jun 3, 2024Updated last year
- Master the art of building and enhancing AI agents. Learn to develop flow-based applications, implement agentic search, and incorporate h…☆63Jun 20, 2024Updated last year
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆31Jul 19, 2025Updated 7 months ago
- Building AI Research Assistant: Multi-Agent RAG System Reading From Multiple Unstructured Sources☆23Jul 15, 2024Updated last year
- A simple framework for using a local Koboldcpp LLM to help with story-writing☆23Nov 26, 2023Updated 2 years ago
- Chat AI (↓↓Scroll to see more↓↓)☆27Jul 24, 2024Updated last year
- An open-source framework for building monolithic or distributed agentic systems, ranging from simple LLM calls to compositional workflows…☆25Jan 14, 2026Updated last month
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆27Dec 13, 2025Updated 2 months ago
- Simple front-end interface for querying a local Ollama API server☆24Dec 1, 2023Updated 2 years ago
- Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3☆25May 22, 2024Updated last year
- Build an LLM powered Ask the Data App with LangChain (using the Pandas DataFrame Agent) and Streamlit☆28Nov 14, 2023Updated 2 years ago
- My implementation of autogen and memgpt agents that work together to create simple scripts and help plan out larger projects.☆30Jan 28, 2024Updated 2 years ago
- ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in c…☆174Oct 16, 2025Updated 4 months ago
- Implementation of Corrective RAG using LangChain and LangGraph.☆28Mar 14, 2025Updated 11 months ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- LLM Chat is an open-source serverless alternative to ChatGPT.☆36Sep 13, 2024Updated last year
- Deep Research through Multi-Agents, using GraphRAG☆85Aug 21, 2025Updated 6 months ago
- A quick implementation of a GenAI News Summary agent using Llama-3 over Groq.☆39Apr 21, 2024Updated last year
- This is a list used to collect the available (open-source / closed-source) projects that comply with Google Agent2Agent.☆13Apr 24, 2025Updated 10 months ago
- Reusable OpenAI secure UI and infrastructure for AI Chat with Azure☆18Feb 16, 2026Updated 2 weeks ago
- 🕹 Pikachu-volleyball game-based multi-agent RL environment using PettingZoo☆11Sep 29, 2024Updated last year
- My portfolio website made with React and Sass☆17Sep 5, 2024Updated last year
- A platform designed to facilitate the development of advanced conversational agents using retrieval augmented generation (RAG).☆34Sep 28, 2025Updated 5 months ago
- Web interface for building and managing your own agentic record label.☆10Updated this week
- Run CrewAI agent workflows on local LLM models with Llamafile and Ollama☆39May 24, 2024Updated last year
- Now Part of Price Per Token. Web tool to count LLM tokens (GPT, Claude, Llama, ...)☆51Dec 5, 2025Updated 3 months ago
- Browser based Interface for Generative AI. Chat/Agent/Taskmanager Hybrid.☆49Feb 23, 2026Updated last week