varunvasudeva1 / llm-server-docsLinks
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
☆668Updated 3 months ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆706Updated 2 months ago
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆801Updated 3 weeks ago
- The Fastest Way to Fine-Tune LLMs Locally☆333Updated last month
- A proxy server for multiple ollama instances with Key security☆575Updated last week
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆2,389Updated this week
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆511Updated 3 weeks ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆678Updated last year
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆528Updated last month
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆368Updated last year
- OpenAPI Tool Servers☆821Updated 4 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆444Updated last year
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆905Updated 2 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆346Updated 11 months ago
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆478Updated this week
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆629Updated last year
- ☆230Updated 8 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆259Updated 3 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆298Updated 9 months ago
- The python library for research and development in NLP, multimodal LLMs, Agents, ML, Knowledge Graphs, and more.☆1,182Updated this week
- API up your Ollama Server.☆189Updated 3 weeks ago
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆479Updated 4 months ago
- Go manage your Ollama models☆1,660Updated last month
- LLMX; Easiest 3rd party Local LLM UI for the web!☆287Updated 2 months ago
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆326Updated 2 weeks ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆262Updated 11 months ago
- ☆200Updated 10 months ago
- plug whisper audio transcription to a local ollama server and ouput tts audio responses☆367Updated 3 months ago
- AI Search tools.☆341Updated 2 months ago
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆847Updated 11 months ago
- Local LLM inference speed tests on various devices☆115Updated 3 weeks ago