大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
☆202Sep 20, 2026Updated 3 weeks ago
Alternatives and similar repositories for llm-inference-capacity-handbook
Users that are interested in llm-inference-capacity-handbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Enhanced GenericAgent with parallel execution and vector memory☆68Mar 9, 2026Updated 7 months ago
- JLens Evolve v3: evidence-centric evolution platform (autonomous Teacher + local Qwen + official SWE-bench native evaluation). Branch cod…☆91Aug 20, 2026Updated last month
- Cross-platform application with intuitive user interface☆15Oct 27, 2025Updated 11 months ago
- 大模型驱动的npc决策，npc和玩家平权☆1,287Mar 29, 2026Updated 6 months ago
- 基于 React + TypeScript + Vite + tailwind 的现代化前端开发框架模板。☆25May 6, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- EOSIO & EVM smart contract unit testing suite and API provider☆15Oct 27, 2025Updated 11 months ago
- Prompts for analytical analysis — ready-to-use LLM prompts that build working analytical-chemistry and MS tools☆95Sep 22, 2026Updated 3 weeks ago
- Repo-native shared memory for AI coding agents.☆108Jul 16, 2026Updated 2 months ago
- ☆257Aug 18, 2026Updated last month
- A conservative AIGC detector-informed thesis rewriting skill for English and Chinese academic writing. Supports Turnitin AI, CNKI AIGC, m…☆495Jun 19, 2026Updated 3 months ago
- 根据任务难度与宿主能力选择执行者，编排子 Agent 的 codex Agent Skill☆97Sep 8, 2026Updated last month
- An application that helps you improve your interview skills☆82May 25, 2026Updated 4 months ago
- 基于 Jingyun Studio + DeepSeek Harness (DSH) 打造的一站式 AI 商业化桌面客户端，一个将 AI 智能体 / 技能 / 工作流转化为可交易商品的完整商业化平台客户端。 井云为 DSH 注入了完整的商业闭环：登录注册 → 会员体系 →…☆1,006Sep 30, 2026Updated 2 weeks ago
- Dual AI Collaboration Framework Builder - Establish clear division of labor between Claude + Codex☆195Aug 15, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- billclaw — the self-hostable collection module (statements in, ledger out) + pa advisor shell. Runs on Cloudflare Workers free tier.☆269Updated this week
- AI-driven UE4.27 game development via MCP + LLM. Includes a complete, packaged Battlefield-style Conquest MiniGame built through this sys…☆94Sep 8, 2026Updated last month
- AI workflow automation plugin for intelligent code generation with Claude/Codex☆886Sep 28, 2026Updated 2 weeks ago
- Interactive Domain Research Intelligent Assistant☆94Jun 5, 2026Updated 4 months ago
- grok-build with the leash off — one binary, any OpenAI-compatible endpoint, zero phone-home. No x.ai account.☆97Sep 2, 2026Updated last month
- Hub for Just-DDL topic repositories and future mini program/app surfaces☆24Jun 18, 2026Updated 3 months ago
- The open source agentic content system to make your contents alive. Self-hosted on any platform. ◑☆663Jun 11, 2026Updated 4 months ago
- Break your AI before they do. Join Discord: https://discord.gg/NXXz8JG74☆1,370Sep 30, 2026Updated 2 weeks ago
- Q-Align-style framework with lightweight LMMs, including 0.8B, 4B, and 9B checkpoints, dataset builders, caching, scoring, and CLI workfl…☆471Jun 24, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Research-paper workflow tool for literature triage and structured reading☆311Oct 6, 2026Updated last week
- A local desktop control center for organizing Codex projects, engineering tasks, sessions, Git changes, Skills, and MCP configuration.☆202Oct 8, 2026Updated last week
- hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid…☆491May 15, 2026Updated 5 months ago
- ☆93Sep 24, 2026Updated 3 weeks ago
- Native Android client to remotely control DeepSeek Harness (DSH) from your phone☆98Aug 28, 2026Updated last month
- Open-source, channel-native agent gateway for Slack. Route team threads to Claude Code, Codex, OpenCode, Docker, HTTP agents, and custom …☆503Jul 10, 2026Updated 3 months ago
- ☆157Apr 20, 2026Updated 5 months ago
- Evaluating the Search Agent in a Parallel World☆78May 15, 2026Updated 5 months ago
- 把简历编辑交给前端，把内容润色交给 Agent☆198Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official repo for 'Large Multimodal Models Evaluation: A Survey'☆552Jun 20, 2026Updated 3 months ago
- Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call gua…☆820Updated this week
- OfficeDex is the first Al-Native VibeOfficing platform for documents, slides, and spreadsheets☆1,069Updated this week
- OPOD: On-Policy Omni Distillation - Code Release☆57Aug 28, 2026Updated last month
- An example smart contract + test suite for communicating over IBC.☆14Oct 27, 2025Updated 11 months ago
- [Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Visio…☆471Jul 30, 2026Updated 2 months ago
- Two image models for face expression recognition and for ethnic classification☆15Oct 27, 2025Updated 11 months ago