π€ Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
β33Jun 10, 2025Updated last year
Alternatives and similar repositories for llm-server
Users that are interested in llm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RAG Chatbot powered by Groq LPU, Ollama and Langchainβ13Mar 5, 2024Updated 2 years ago
- Steerable Harnesses for DeepAgents β OrchestraπͺΆβ16Jun 15, 2026Updated last month
- Integrated LLM-based document and data Q&A with knowledge graph visualizationβ24Dec 9, 2023Updated 2 years ago
- Minimal RAG (Retrieval Augmented Generation) website with Pinecone, FastAPI, NextJS, MongoDBβ11Jun 30, 2024Updated 2 years ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.β31Jul 19, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language usingΒ LLMsβ16Aug 23, 2024Updated last year
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilotβ47Jun 9, 2025Updated last year
- β18Mar 17, 2025Updated last year
- A CLI tool you can pipe code and then ask for changes, add documentation, etc, using the OpenAI API.β13Jan 5, 2024Updated 2 years ago
- learning to code in pythonβ10Sep 20, 2020Updated 5 years ago
- Building AI Research Assistant: Multi-Agent RAG System Reading From Multiple Unstructured Sourcesβ23Jul 15, 2024Updated 2 years ago
- Consume a stream of data into a binary Buffer as efficiently as possibleβ12Jun 21, 2018Updated 8 years ago
- Obrew Server: A self-hostable machine learning engine. Build agents and schedule workflows private to you.β17May 16, 2026Updated 2 months ago
- Retrieval augmented generation demos with open-source DeepSeek, Llama, Qwen, Mistral, Gemmaβ42Aug 18, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A web based whiteboard using Django channels and JSON Web Tokensβ21Mar 31, 2016Updated 10 years ago
- β15Sep 13, 2024Updated last year
- This repository contains a toy implementation of a basic RAQA system.β21Jun 3, 2024Updated 2 years ago
- Python wrapper and CLI for Groq's LPU inference API.β25Apr 23, 2026Updated 3 months ago
- LLM Chat is an open-source serverless alternative to ChatGPT.β36Sep 13, 2024Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β70Nov 17, 2025Updated 8 months ago
- Competitive coding submissions at Leetcode goes hereβ16Aug 22, 2021Updated 4 years ago
- A plugin for hapi.js that generates etags for your responsesβ10Jul 22, 2018Updated 8 years ago
- My implementation of autogen and memgpt agents that work together to create simple scripts and help plan out larger projects.β30Jan 28, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- https://pypi.org/project/deepagents-sandbox/β26Apr 22, 2026Updated 3 months ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!β17Dec 22, 2025Updated 7 months ago
- The Version Control System for Google Drive and Dropboxβ10Aug 27, 2018Updated 7 years ago
- X TypeScript Bindingsβ11Nov 23, 2023Updated 2 years ago
- Stateful AI Agent for Knowledge Extractionβ20Dec 21, 2025Updated 7 months ago
- Implementation of Corrective RAG using LangChain and LangGraph.β29May 13, 2026Updated 2 months ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)β10Feb 2, 2024Updated 2 years ago
- Agentis is an application interface for your local AI models with Ollama allowing you to speak with text and voice with your LLM.β16Jan 23, 2024Updated 2 years ago
- Window manager scripts and configsβ18Sep 17, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β14Sep 18, 2024Updated last year
- Lightweight, secure and login like console display manager for Xβ16Nov 1, 2021Updated 4 years ago
- Work-in-progress on converting Pywal colors to a matching Chrome themeβ11Dec 15, 2019Updated 6 years ago
- Custom scripts for i3blocks written in bash.β18Apr 22, 2020Updated 6 years ago
- UNITE: A Unified Benchmark for Text-to-SQL Evaluationβ88May 30, 2025Updated last year
- Simple front-end interface for querying a local Ollama API serverβ24Dec 1, 2023Updated 2 years ago
- π€ AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.β17Jan 14, 2024Updated 2 years ago