A web-based calculator for estimating GPU memory requirements and maximum concurrent requests for self-hosted LLM inference.
☆50Jun 11, 2026Updated 3 months ago
Alternatives and similar repositories for selfhostllm
Users that are interested in selfhostllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- On device Firewall for Coding and Personal Agents☆928Sep 5, 2026Updated 2 weeks ago
- Minimalistic Rust library for working with musical notes, frequencies (Hz), MIDI numbers, and pitch operations like transposition and oct…☆18May 30, 2025Updated last year
- A command line tool to automate the process of installing packages and apps on your mac.☆16Apr 25, 2019Updated 7 years ago
- An MCP server implementation providing a standardized interface for LLMs to interact with the Atla API.☆17Jul 21, 2025Updated last year
- Measuring Thinking Efficiency in Reasoning Models - Research Repository☆40Dec 2, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Multi-stream video inference with Ultralytics YOLO - Display multiple video streams in a grid layout with real-time object detection.☆17May 20, 2026Updated 3 months ago
- Open Source pipeline lib with backpressure☆13Dec 11, 2023Updated 2 years ago
- Docs for all things Agno <v2.0.0☆47Sep 28, 2025Updated 11 months ago
- Run and manage both vLLM and llama.cpp model servers from one terminal UI + CLI — shared Docker Compose profiles, live tok/s, and cross-b…☆26Sep 3, 2026Updated 2 weeks ago
- Convert unstructured text into structured datasets☆27Apr 15, 2026Updated 5 months ago
- EQGRP: Replicating DarkPulsar, an DLL capable of hooking Security Package Method Tables on the Heap!☆15Oct 11, 2020Updated 5 years ago
- ☆12Oct 17, 2024Updated last year
- Threat Network Detection in Online Social Networks☆11Jan 20, 2017Updated 9 years ago
- implement similar functionalities using different java concurrency utilities and compare the performance☆12Dec 7, 2016Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- MCP server for SecretiveShell/Awesome-llms-txt. Add documentation directly into your conversation via MCP resources.☆25Mar 9, 2025Updated last year
- Principles of Ecology☆12Nov 18, 2021Updated 4 years ago
- Claude Skill for direct access to Google Search Console, GA4, and Bing Webmaster Tools data — query your real SEO numbers from Claude.☆23May 4, 2026Updated 4 months ago
- S4IL's Open Sourced Hill Climb Racing Hack Menu made using Python☆31Oct 29, 2025Updated 10 months ago
- Delve is a debugger for the Go programming language.☆11Apr 9, 2023Updated 3 years ago
- libtpms / swtpm software emulation of a Trusted Platform Module (TPM 1.2 and TPM 2.0) compile script☆13Sep 16, 2020Updated 6 years ago
- A local-first, infinite canvas that turns linear AI chats into a spatial knowledge graph.☆21Jan 27, 2026Updated 7 months ago
- ☆38Nov 17, 2025Updated 10 months ago
- Learn how to build agents that can reason over their own documents☆14May 21, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI Agent On-chain Living, Breathing Virtual World — where AI agents earn, trade, own property, and form social structures entirely on-cha…☆56Mar 10, 2026Updated 6 months ago
- Public accompanying repository for Universite de Montreal's IFT 6757: Autnonomous Vehicles, Fall 2019.☆11Jun 21, 2022Updated 4 years ago
- One dashboard for all your AI assistants☆17Updated this week
- ☆33Sep 12, 2026Updated last week
- Library that provides a wrapper to propagate and manage database transactions☆15Mar 9, 2024Updated 2 years ago
- Official Tressel plugin to export various content from the Internet (like Twitter, Reddit, Kindle and more) into Obsidian☆24Jul 9, 2023Updated 3 years ago
- Reddcoin 4.22☆24Sep 11, 2026Updated last week
- Standard email templates based on hundreds of real-world emails, including newsletters, on-boarding emails, announcements, events, produc…☆14May 23, 2026Updated 3 months ago
- Introspection dashboard for the pi coding agent — tools, prompts, skills, and the system prompt injected on init.☆40May 20, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Low-latency IPC library for building persistent agentic tool servers (LLM inference, TTS, vector search, browser automation) over named p…☆15Updated this week
- Every system has its `telos´ — its final cause. This CLI fulfills the purpose of MindsDB's Knowledge Base: to seek, structure, and serve …☆20Dec 19, 2025Updated 9 months ago
- Unified multi-layer caching library for AI/agent pipelines — LangChain, LangGraph, AutoGen, CrewAI, Agno, A2A☆30Jun 4, 2026Updated 3 months ago
- k8s CSI driver for FastCFS☆13Mar 17, 2024Updated 2 years ago
- In this project, I developed a Food and Calorie Tracker API using FastAPI, PostgreSQL, OAuth2, and JWT for secure user authentication. Th…☆12Oct 28, 2024Updated last year
- Code library which defines skeleton of scenarios implemented using va rious actions and expectations.☆10Oct 26, 2020Updated 5 years ago
- PDF Readr + AI Chat - Turn docs into conversations☆18Sep 26, 2025Updated 11 months ago