A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆48Jun 11, 2026Updated 3 weeks ago
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Interact with various LLMs in your browser (LangChain.js, Angular)☆17May 7, 2026Updated last month
- GRONG is a DNS (Domain Name System) authoritative name server.It is more a research project than a production-ready program.☆64Jan 3, 2011Updated 15 years ago
- ☆27Nov 6, 2024Updated last year
- ☆19Aug 23, 2025Updated 10 months ago
- ☆41May 26, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- vTPM with SGX protection☆12May 30, 2019Updated 7 years ago
- libtpms / swtpm software emulation of a Trusted Platform Module (TPM 1.2 and TPM 2.0) compile script☆13Sep 16, 2020Updated 5 years ago
- ☆22Dec 9, 2025Updated 6 months ago
- Repository with environment and training scripts for paper "Cross-Environment-Cooperation Enables Zero-shot Multi-agent Cooperation"☆22Sep 12, 2025Updated 9 months ago
- Metadata Editor user and practice guide☆19May 8, 2026Updated last month
- Authenticated independently verifiable agent delegation.☆36Jun 26, 2026Updated last week
- Verify that any MCP server is running the intended and untampered code via hardware attestation.☆20May 20, 2026Updated last month
- k8s CSI driver for FastCFS☆13Mar 17, 2024Updated 2 years ago
- 📦 Repopack is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your …☆17Oct 15, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SnapDocs - A Modern, Open-Source Document Workspace☆25Sep 7, 2025Updated 9 months ago
- ☆18Sep 22, 2024Updated last year
- ☆44Jan 16, 2026Updated 5 months ago
- A lightweight, self-hosted infrastructure layer for deploying and managing LLM agents as resilient microservices. Features automatic r…☆18Aug 4, 2025Updated 11 months ago
- ☆22Jun 12, 2026Updated 3 weeks ago
- The core repository for Katanemo's advanced function calling models with top-tier performance. Features three collections: Arch-Function …☆22Jun 23, 2025Updated last year
- Official Code Repository for ResearchAgent (NAACL 2025)☆43Aug 24, 2025Updated 10 months ago
- 🔍📃 LLM-powered PDF Table Extractor☆19Jun 26, 2025Updated last year
- ☆36Nov 5, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spellbound - your multilingual AI-powered writing assistant☆13May 12, 2025Updated last year
- SwarmBrain: Embodied agent for real-time strategy game StarCraft II via large language models☆28Apr 11, 2024Updated 2 years ago
- A simple HTTP server that wraps an unofficial free WhatsApp API.☆14Aug 19, 2025Updated 10 months ago
- weavetui is a modern, robust, and modular Text User Interface (TUI) framework for Rust, built on top of ratatui and tokio☆24Mar 7, 2026Updated 3 months ago
- Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU☆21May 31, 2026Updated last month
- Whim is a simple and secure app for sharing secret messages anonymously. The messages are encrypted and are vanished after being read. No…☆28May 26, 2026Updated last month
- A simpler multiplexer, built with OpenTUI.☆83Jun 16, 2026Updated 2 weeks ago
- 🧠 High-performance persistent memory system for Model Context Protocol (MCP) powered by libSQL. Features vector search, semantic knowled…☆85Jun 28, 2026Updated last week
- Enemies for your LLM☆38Jan 20, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆39Aug 4, 2025Updated 11 months ago
- BMAD skills and workflows for OpenAI Codex (App, CLI, Web): intent-based execution, YAML project state, and reusable skill packs for plan…☆36May 19, 2026Updated last month
- tldw☆12Jul 5, 2025Updated last year
- A simple music-as-code library and synthesizer for rust☆15Mar 15, 2026Updated 3 months ago
- Command-line toolkit for interactive SQL and data manipulation on CSV, Parquet, JSON, and Avro files. Powered by Apache Arrow and DataFus…☆15May 2, 2025Updated last year
- Quartet II Official Code☆75May 1, 2026Updated 2 months ago
- Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launc…☆23Mar 14, 2025Updated last year