大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
☆124Sep 20, 2026Updated this week
Alternatives and similar repositories for llm-inference-capacity-handbook
Users that are interested in llm-inference-capacity-handbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Enhanced GenericAgent with parallel execution and vector memory☆68Mar 9, 2026Updated 6 months ago
- 基于 React + TypeScript + Vite + tailwind 的现代化前端开发框架模板。☆25May 6, 2026Updated 4 months ago
- Prompts for analytical analysis — ready-to-use LLM prompts that build working analytical-chemistry and MS tools☆96Updated this week
- Repo-native shared memory for AI coding agents.☆107Jul 16, 2026Updated 2 months ago
- A conservative AIGC detector-informed thesis rewriting skill for English and Chinese academic writing. Supports Turnitin AI, CNKI AIGC, m…☆486Jun 19, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 根据任务难度与宿主能力选择执行者，编排子 Agent 的 codex Agent Skill☆98Sep 8, 2026Updated 2 weeks ago
- An application that helps you improve your interview skills☆82May 25, 2026Updated 4 months ago
- 大模型驱动的npc决策，npc和玩家平权☆1,212Mar 29, 2026Updated 5 months ago
- Dual AI Collaboration Framework Builder - Establish clear division of labor between Claude + Codex☆196Aug 15, 2026Updated last month
- Interactive Domain Research Intelligent Assistant☆96Jun 5, 2026Updated 3 months ago
- grok-build with the leash off — one binary, any OpenAI-compatible endpoint, zero phone-home. No x.ai account.☆97Sep 2, 2026Updated 3 weeks ago
- Hub for Just-DDL topic repositories and future mini program/app surfaces☆24Jun 18, 2026Updated 3 months ago
- 基于 Jingyun Studio + DeepSeek Harness (DSH) 打造的一站式 AI 商业化桌面客户端，一个将 AI 智能体 / 技能 / 工作流转化为可交易商品的完整商业化平台客户端。 井云为 DSH 注入了完整的商业闭环：登录注册 → 会员体系 →…☆615Updated this week
- JLens Evolve v3: evidence-centric evolution platform (autonomous Teacher + local Qwen + official SWE-bench native evaluation). Branch cod…☆92Aug 20, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The open source agentic content system to make your contents alive. Self-hosted on any platform. ◑☆662Jun 11, 2026Updated 3 months ago
- Native Android client to remotely control DeepSeek Harness (DSH) from your phone☆98Aug 28, 2026Updated 3 weeks ago
- hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid sdk | hyperliquid…☆491May 15, 2026Updated 4 months ago
- A local desktop control center for organizing Codex projects, engineering tasks, sessions, Git changes, Skills, and MCP configuration.☆203Updated this week
- ☆94Updated this week
- AI workflow automation plugin for intelligent code generation with Claude/Codex☆886Updated this week
- Evaluating the Search Agent in a Parallel World☆78May 15, 2026Updated 4 months ago
- 把简历编辑交给前端，把内容润色交给 Agent☆197Sep 17, 2026Updated last week
- OfficeDex is the first Al-Native VibeOfficing platform for documents, slides, and spreadsheets☆1,066Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Q-Align-style framework with lightweight LMMs, including 0.8B, 4B, and 9B checkpoints, dataset builders, caching, scoring, and CLI workfl…☆468Jun 24, 2026Updated 3 months ago
- OPOD: On-Policy Omni Distillation - Code Release☆55Aug 28, 2026Updated 3 weeks ago
- An example smart contract + test suite for communicating over IBC.☆14Oct 27, 2025Updated 10 months ago
- Two image models for face expression recognition and for ethnic classification☆15Oct 27, 2025Updated 10 months ago
- 面向企业的数字员工构建与运行平台：把专业员工的经验、流程与判断标准，固化为可随时上岗、可配置、可审批、可观测的 AI 数字员工。☆275Updated this week
- HunterCode · Community Edition · 腾讯 WorkBuddy 金融版的开源本地替代方案 · open-source, local alternative to Tencent WorkBuddy Finance Edition · 多智能体投研…☆549Updated this week
- Break your AI before they do. Join Discord: https://discord.gg/NXXz8JG74☆1,086Updated this week
- Truffle, Webpack, React, Redux boilerplate with routing and authentication via a smart contract.☆15Oct 27, 2025Updated 10 months ago
- understandingethereumtrie=================☆15Oct 27, 2025Updated 10 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Cross-platform application with intuitive user interface☆15Oct 27, 2025Updated 10 months ago
- Self-designing, durable, self-improving agent orchestration: describe a goal — an agent designs the graph, a fleet of sealed full-agent n…☆94Jul 24, 2026Updated 2 months ago
- Research-paper workflow tool for literature triage and structured reading☆303Updated this week
- DeepTime Sauropsida：交互式蜥形纲演化树，3D 螺旋序幕 + D3.js 动态时间树，跨越 3 亿年 | Interactive sauropsid phylogeny with 3D spiral intro & D3.js dynamic timetr…☆20Aug 8, 2026Updated last month
- Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC, audit logs, rate limiting, and cost tracking ac…☆815Sep 15, 2026Updated last week
- 一个可移植的多 agent 协作 skill，适用于 3 个及以上 AI agent。它能够自动识别 agent 的工具、权限和专长，分配协调者、实现者、验证者等角色；通过单一主写入者机制避免文件冲突；对重要任务执行“规划 → 实现 → 独立复核 → 最终验收”流程，并通过…☆97Aug 23, 2026Updated last month
- AI coding agent with one Python core and three front-ends — headless CLI, Textual TUI, and an Electron desktop. Works with any OpenAI-com…☆146Updated this week