varunvasudeva1 / llm-server-docsLinks
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
☆575Updated 2 weeks ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- A proxy server for multiple ollama instances with Key security☆508Updated last week
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆390Updated last week
- The Fastest Way to Fine-Tune LLMs Locally☆322Updated 7 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆664Updated last month
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆253Updated last week
- AI Search tools.☆339Updated 6 months ago
- The AI toolkit for the AI developer☆1,021Updated this week
- open source assistant hybrid using small models (2b - 5b) and gemini , with image and agentic tool capabilities and integration of RAG…☆213Updated 3 weeks ago
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆784Updated 2 weeks ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆464Updated this week
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆521Updated 7 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆358Updated last year
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆2,117Updated 3 weeks ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆264Updated 7 months ago
- OpenAPI Tool Servers☆713Updated last month
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆470Updated last month
- A beautiful local-first coding agent running in your terminal - built by the community for the community ⚒☆749Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆278Updated 6 months ago
- tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer' (Open Source N…☆1,088Updated this week
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆398Updated 9 months ago
- ☆190Updated 6 months ago
- Code execution utilities for Open WebUI & Ollama☆300Updated 11 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆256Updated 8 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆847Updated 6 months ago
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆300Updated 2 months ago
- ☆226Updated 5 months ago
- Building blocks for rapid development of GenAI applications☆1,583Updated this week
- 🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API comp…☆121Updated 11 months ago
- Using Gemma-3 Vision☆128Updated 3 weeks ago
- Abbey is a self-hosted configurable AI interface with workspaces, document chats, YouTube chats, and more. Find our hosted version at htt…☆407Updated 6 months ago