erans / selfhostllmLinks
A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆20Updated 2 months ago
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below
Sorting:
- Boost Your Productivity with Nyro☆110Updated last year
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆238Updated last week
- Datu Core AI Analyst open-source☆42Updated last month
- iauto is a low-code engine for building and deploying AI agents☆91Updated 11 months ago
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆22Updated 3 months ago
- jemma & her ai agents that build software☆94Updated last year
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆102Updated 11 months ago
- ☆253Updated this week
- Chat strategies for LLMs☆106Updated last year
- AgentX python SDK. Build multi-agent AI workforce.☆43Updated 4 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆225Updated 10 months ago
- The Ultimate Open-Source RAG-as-a-Service Platform ☕☆50Updated 5 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆58Updated 11 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆31Updated 7 months ago
- Chrome extension that interacts with content using Groq☆41Updated 10 months ago
- An easy Python framework to build distributed systems☆50Updated last year
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆80Updated last month
- A framework for hosting and scaling AI agents.☆38Updated 11 months ago
- Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.☆33Updated 2 months ago
- A simple CPU only OCR for pdf/images/word/excel to markdown. With streamlit.☆23Updated 2 months ago
- Analyze your image in seconds with AI☆63Updated last year
- Find and get started with the best AI Agents and AI Automation tools on the Internet. Start building your own AI Agents powered workforce…☆37Updated 10 months ago
- A background agent system for automating end-to-end software engineering tasks, direct from your github repos.☆176Updated 4 months ago
- Your powerful publishing rich text editor☆49Updated 2 months ago
- Personal project, Generative AI, Streamlit, Python☆54Updated 6 months ago
- All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP☆144Updated this week
- Build Secure and Compliant AI agents and MCP Servers. YC W23☆152Updated 5 months ago
- ☆178Updated 3 months ago
- Byte-Vision is a privacy-first document intelligence platform that transforms static documents into an interactive, searchable knowledge …☆63Updated last month
- VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for cor…☆76Updated last month