erans / selfhostllmLinks
A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆31Updated last month
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below
Sorting:
- Datu Core AI Analyst open-source☆42Updated 4 months ago
- AgentX python SDK. Build multi-agent AI workforce.☆44Updated 7 months ago
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆23Updated 5 months ago
- 🤖 AI agents on autopilot. Any model. Runs local, cron, CI/CD, or Docker.☆141Updated last week
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆32Updated 8 months ago
- ☆66Updated 11 months ago
- AI Powered Transform raw notes into polished, professional formats☆35Updated 5 months ago
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆27Updated last year
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆91Updated 4 months ago
- Boost Your Productivity with Nyro☆112Updated last year
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆30Updated 10 months ago
- Minimal AI agent system for Claude Code. One agent to rule them all - agent-architect creates project-specific agents on demand.☆29Updated last month
- Production-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-l…☆36Updated last week
- CodeSmelt is a command-line tool that melts down your Git project’s source code into a single, well-organized file. It concatenates all s…☆24Updated 11 months ago
- ☆24Updated 11 months ago
- AI-powered terminal assistant that transforms command failures into learning opportunities. Automatically detects errors, analyzes contex…☆72Updated 4 months ago
- Ready-to-use agent that can interact directly with any tool or native endpoint, in less than 5 lines of code☆43Updated 3 months ago
- MidStream is a powerful platform that makes AI conversations smarter and more responsive. Instead of waiting for an AI to finish speaking…☆58Updated this week
- An open source implementation of an AI agent that generates slides in google slides☆117Updated last month
- an auto coder which automatically fixes errors and improves the code from simple user prompt☆37Updated last year
- A background agent system for automating end-to-end software engineering tasks, direct from your github repos.☆192Updated 6 months ago
- Chrome extension that interacts with content using Groq☆41Updated last year
- A Simple Scenes Based Movie Generation App☆52Updated last year
- A tool to use the Ai2 Open Coding Agents Soft-Verified Efficient Repository Agents (SERA) model with Claude Code☆108Updated this week
- a flexible and customizable React chat component for integrating Parlant's chatbot seamlessly into your website.☆124Updated 2 weeks ago
- Open Source AI Made Simple☆92Updated last month
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆225Updated 3 months ago
- The Ultimate Open-Source RAG-as-a-Service Platform ☕☆50Updated 7 months ago
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated last year
- A task management system designed for AI development☆72Updated this week