erans / selfhostllmLinks
A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆32Updated last month
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below
Sorting:
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆23Updated 6 months ago
- AgentX python SDK. Build multi-agent AI workforce.☆45Updated 7 months ago
- Boost Your Productivity with Nyro☆112Updated last year
- A framework for hosting and scaling AI agents.☆39Updated last year
- We handle what engineers and IDEs won't: generating and maintaining technical documentation for your codebase, while also providing searc…☆188Updated 4 months ago
- The Ultimate Open-Source RAG-as-a-Service Platform ☕☆52Updated 8 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- A task management system designed for AI development☆72Updated last week
- Low code framework to build and launch a crew of AI agents with shared state. Built with https://axllm.dev.☆40Updated 3 weeks ago
- 🤖 AI agents on autopilot. Any model. Runs local, cron, CI/CD, or Docker.☆176Updated last week
- open-source, local-first AI CLI for developers. It connects to your local Ollama models or remote providers like OpenAI, Anthropic, Gemin…☆55Updated 3 weeks ago
- iauto is a low-code engine for building and deploying AI agents☆93Updated last year
- an auto coder which automatically fixes errors and improves the code from simple user prompt☆37Updated last year
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆30Updated 10 months ago
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆27Updated last year
- ☆120Updated 6 months ago
- Test-Time Memory Framework: Control Hallucinations in Foundation Models☆11Updated 3 months ago
- A tool to use the Ai2 Open Coding Agents Soft-Verified Efficient Repository Agents (SERA) model with Claude Code☆204Updated last week
- A tool to OCR PDFs using gen-AI models☆46Updated last month
- Ready-to-use agent that can interact directly with any tool or native endpoint, in less than 5 lines of code☆44Updated 3 months ago
- ☆36Updated 2 months ago
- ☆24Updated 11 months ago
- a flexible and customizable React chat component for integrating Parlant's chatbot seamlessly into your website.☆125Updated 3 weeks ago
- Open Source Local Data Analysis Assistant.☆187Updated 3 months ago
- Chrome extension that interacts with content using Groq☆41Updated last year
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆227Updated 3 months ago
- Code for WALT – Web Agents that Learn Tools☆63Updated 3 months ago
- Datu Core AI Analyst open-source☆42Updated 4 months ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆49Updated 3 months ago
- Chat strategies for LLMs☆129Updated 3 weeks ago