varunvasudeva1 / llm-server-docsLinks
Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and ComfyUI.
☆518Updated 3 months ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- The Fastest Way to Fine-Tune LLMs Locally☆314Updated 4 months ago
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆302Updated last week
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆511Updated 5 months ago
- A proxy server for multiple ollama instances with Key security☆476Updated 2 weeks ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆741Updated last week
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆467Updated 2 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆625Updated 3 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆256Updated 5 months ago
- AI Search tools.☆329Updated 4 months ago
- The AI toolkit for the AI developer☆854Updated last week
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆358Updated 9 months ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆456Updated last week
- 🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API comp…☆113Updated 9 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆278Updated 4 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆396Updated 6 months ago
- ☆219Updated 3 months ago
- Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools☆110Updated last month
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆248Updated 6 months ago
- ☆1,012Updated last week
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,977Updated last week
- API up your Ollama Server.☆167Updated 2 months ago
- open source assistant using small models (2b - 5b) , with agentic and tool calling capabilities and integration of RAG with effiecient …☆205Updated 3 weeks ago
- Abbey is a self-hosted configurable AI interface with workspaces, document chats, YouTube chats, and more. Find our hosted version at htt…☆399Updated 3 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆604Updated 9 months ago
- Search the web and your self-hosted apps using local AI agents.☆458Updated 8 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆321Updated 10 months ago
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆130Updated last month
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆103Updated 4 months ago
- ☆186Updated 4 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆391Updated 3 months ago