erans / selfhostllmLinks
A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆20Updated last month
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below
Sorting:
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆22Updated 2 months ago
- A tool to OCR PDFs using gen-AI models☆44Updated 4 months ago
- Run AI generated code in isolated sandboxes☆112Updated 8 months ago
- AgentX python SDK. Build multi-agent AI workforce.☆43Updated 3 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆28Updated 6 months ago
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆101Updated 10 months ago
- ☆214Updated last week
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated last year
- AI Agent toolkit for adapting Glean's enterprise tools across multiple frameworks☆41Updated last week
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆26Updated 4 months ago
- A framework for hosting and scaling AI agents.☆38Updated 10 months ago
- An advanced Digital Worker framework for AI agent-driven research and process automations.☆43Updated 7 months ago
- ☆61Updated 8 months ago
- Minimal AI agent system for Claude Code. One agent to rule them all - agent-architect creates project-specific agents on demand.☆26Updated 2 months ago
- Low code framework to build and launch a crew of AI agents with shared state. Built with https://axllm.dev.☆36Updated last month
- A Simple Scenes Based Movie Generation App☆51Updated 11 months ago
- an auto coder which automatically fixes errors and improves the code from simple user prompt☆36Updated 9 months ago
- 👷♂️Minion is Agent's Brain. Minion is designed to execute any type of queries, offering a variety of features that demonstrate its flex…☆24Updated this week
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated last year
- Augment AI agents with long-term memory through knowledge graph 🧠☆80Updated 11 months ago
- MarinaBox is a toolkit for creating and managing secure, isolated environments for AI agents☆137Updated 7 months ago
- ☆57Updated 8 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated last year
- Auto Thinking Mode switch for Qwen3 in Open webui☆68Updated 5 months ago
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆228Updated this week
- We handle what engineers and IDEs won't: generating and maintaining technical documentation for your codebase, while also providing searc…☆175Updated 2 weeks ago
- A daemon that makes a desktop OS accessible to AI agents☆33Updated 4 months ago
- A Multi-Agentic AI Assistant/Builder☆24Updated last month
- Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…☆22Updated last year
- The Ultimate Open-Source RAG-as-a-Service Platform ☕☆50Updated 4 months ago