🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
☆33Jun 10, 2025Updated last year
Alternatives and similar repositories for llm-server
Users that are interested in llm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RAG Chatbot powered by Groq LPU, Ollama and Langchain☆13Mar 5, 2024Updated 2 years ago
- About FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numerous open-source LLMs via Llama.cpp…☆15May 25, 2024Updated 2 years ago
- Integrated LLM-based document and data Q&A with knowledge graph visualization☆24Dec 9, 2023Updated 2 years ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated last year
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆48Jun 9, 2025Updated last year
- Consume a stream of data into a binary Buffer as efficiently as possible☆12Jun 21, 2018Updated 8 years ago
- A reusable leave-behind for enterprise customers showing the differentiator of using the best Vector Store in the world: Astra DB☆22Feb 2, 2024Updated 2 years ago
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆25Oct 6, 2026Updated last week
- LLM Chat is an open-source serverless alternative to ChatGPT.☆36Sep 13, 2024Updated 2 years ago
- A plugin for hapi.js that generates etags for your responses☆10Jul 22, 2018Updated 8 years ago
- Python wrapper and CLI for Groq's LPU inference API.☆25Apr 23, 2026Updated 5 months ago
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆17Dec 22, 2025Updated 9 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of Corrective RAG using LangChain and LangGraph.☆30May 13, 2026Updated 5 months ago
- Stateful AI Agent for Knowledge Extraction☆21Dec 21, 2025Updated 9 months ago
- ☆14May 7, 2015Updated 11 years ago
- Building Private Healthcare AI Assistant for Clinics Using Qdrant Hybrid Cloud, DSPy and Groq - Llama3☆25May 22, 2024Updated 2 years ago
- Allow an AI agent to control an iPad through a USB input tool, native screen sharing, and a control server.☆79Updated this week
- Window manager scripts and configs☆18Sep 17, 2022Updated 4 years ago
- ☆14Sep 18, 2024Updated 2 years ago
- Lightweight, secure and login like console display manager for X☆16Nov 1, 2021Updated 4 years ago
- SEO Suggestions from GPT using Keyword Ranking based on search volume, CPC and paid competition.☆12Jun 28, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🚀 [Project] Agentis is an application interface for your local AI models with Ollama allowing you to speak with text and voice with your…☆18Jan 23, 2024Updated 2 years ago
- stream-of-consciousness experience of an AI's thinking process, complete with creative tangents and unexpected connections.☆14Jan 29, 2025Updated last year
- Simple front-end interface for querying a local Ollama API server☆24Dec 1, 2023Updated 2 years ago
- A screen capture tool that allows you to capture recordings from the past!☆15Jun 27, 2021Updated 5 years ago
- Build an LLM powered Ask the Data App with LangChain (using the Pandas DataFrame Agent) and Streamlit☆29Nov 14, 2023Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- Grunt ElasticBeanstalk deployment task☆11Mar 22, 2017Updated 9 years ago
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 3 years ago
- Node FHIR facade server built on Asymmetrik node-fhir-server-core.☆13Dec 22, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- API GPT4 Free☆14Jan 31, 2024Updated 2 years ago
- An AI toolkit for performing complex internet lookups, crawls and summaries. It utilizes and constantly expands it's knowledge stores wit…☆22Jul 27, 2024Updated 2 years ago
- Learn Python for IT! 🐍 Hands-on projects & exercises for aspiring coders. From basics to advanced, join our community, code like a pro! …☆10Mar 10, 2025Updated last year
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated 2 years ago
- Simple "push to talk" for Pulseaudio on GNU/Linux Desktop in user mode wrote in python (command line only)☆11Apr 8, 2026Updated 6 months ago
- Automatically generate tests for your website by using LLM models☆16Aug 7, 2023Updated 3 years ago
- a simple Whatsapp chatbot responding curl of Flowise.☆12Jul 6, 2023Updated 3 years ago