varunvasudeva1 / llm-server-docsLinks
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
☆683Updated 2 weeks ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- The Fastest Way to Fine-Tune LLMs Locally☆333Updated last month
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆711Updated 3 months ago
- One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆2,406Updated last week
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆802Updated last month
- A proxy server for multiple ollama instances with Key security☆582Updated this week
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆560Updated last week
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆483Updated 5 months ago
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆528Updated 2 months ago
- Go manage your Ollama models☆1,666Updated last month
- The python library for research and development in NLP, multimodal LLMs, Agents, ML, Knowledge Graphs, and more.☆1,189Updated this week
- Pipelines: Versatile, UI-Agnostic OpenAI-Compatible Plugin Framework☆2,273Updated 5 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆368Updated last year
- API up your Ollama Server.☆191Updated last month
- ☆230Updated 9 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆260Updated 3 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆322Updated last year
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆299Updated 10 months ago
- open source assistant hybrid using small models (2b - 5b) and gemini , with image and agentic tool capabilities and integration of RAG…☆228Updated 4 months ago
- AI Search tools.☆341Updated 3 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆911Updated 2 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆447Updated last year
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆262Updated 11 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆629Updated last year
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆681Updated last year
- OpenAPI Tool Servers☆825Updated 4 months ago
- Building blocks for rapid development of GenAI applications☆1,617Updated this week
- Search the web and your self-hosted apps using local AI agents.☆567Updated last year
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆1,433Updated 4 months ago
- ☆1,246Updated last week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆438Updated 2 months ago