erans / selfhostllmLinks
A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆25Updated last month
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below
Sorting:
- AgentX python SDK. Build multi-agent AI workforce.☆44Updated 6 months ago
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆23Updated 5 months ago
- Boost Your Productivity with Nyro☆111Updated last year
- Ready-to-use agent that can interact directly with any tool or native endpoint, in less than 5 lines of code☆43Updated 2 months ago
- A framework for hosting and scaling AI agents.☆38Updated last year
- The Ultimate Open-Source RAG-as-a-Service Platform ☕☆51Updated 7 months ago
- a flexible and customizable React chat component for integrating Parlant's chatbot seamlessly into your website.☆119Updated last month
- 🤖 AI agents on autopilot. Any model. Runs local, cron, CI/CD, or Docker.☆131Updated this week
- Task driven LLM multi agent framework that gives you the building blocks to create anything you wish☆80Updated this week
- ☆24Updated 11 months ago
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆27Updated last year
- We handle what engineers and IDEs won't: generating and maintaining technical documentation for your codebase, while also providing searc…☆187Updated 3 months ago
- AI conflict resolution framework designed to work alongside existing AI orchestration tools☆24Updated last year
- Test-Time Memory Framework: Control Hallucinations in Foundation Models☆11Updated 2 months ago
- Deep research tool for local knowledge base.☆149Updated 3 weeks ago
- A background agent system for automating end-to-end software engineering tasks, direct from your github repos.☆190Updated 6 months ago
- Minimal AI agent system for Claude Code. One agent to rule them all - agent-architect creates project-specific agents on demand.☆29Updated 3 weeks ago
- Production-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-l…☆36Updated 2 months ago
- AI Powered Transform raw notes into polished, professional formats☆35Updated 4 months ago
- Open Source AI Made Simple☆92Updated last month
- ☆57Updated 4 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Updated last year
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆220Updated 2 months ago
- A tool to OCR PDFs using gen-AI models☆46Updated 2 weeks ago
- Make your LLM agent and chat with it simple and fast!☆67Updated last month
- A task management system designed for AI development☆70Updated 2 weeks ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- A simple AI Agent Framework using table software like Excel/Google Sheets as GUI☆17Updated last year
- Flowchart-like UI to interconnect LLM's and Huggingface models, and deploy them as a REST API with little to no code.☆72Updated 9 months ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆48Updated 2 months ago