Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆31Jul 19, 2026Updated last month
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementations of Agent-as-a-Router: Agentic Model Routing for Coding Tasks.☆955Jun 29, 2026Updated 2 months ago
- The agent that remembers and learns.☆1,726Jul 18, 2026Updated last month
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆79Jul 16, 2026Updated last month
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆707Aug 12, 2026Updated 2 weeks ago
- Official Implementation of OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation☆272Jul 5, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four …☆225Jul 14, 2026Updated last month
- Self-Supervised Deep Learning for Fisheye Image Rectification (pytorch implementation).☆342Aug 13, 2025Updated last year
- dat release☆225Aug 6, 2026Updated 3 weeks ago
- ☆154Jun 30, 2026Updated 2 months ago
- polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polym…☆272Updated this week
- ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethe…☆249Jul 14, 2026Updated last month
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆1,983Aug 17, 2026Updated 2 weeks ago
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆144Updated this week
- Nukkit Plugin: Protect yourself from griefers by placing a protection block!☆232Jan 4, 2026Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official DIDA Hotel Booking MCP Server. 14-year travel tech data stack, 2M+ hotels at wholesale rates, 40+ LLM compatible. Free unlimited…☆81Aug 4, 2026Updated 3 weeks ago
- Full-stack open-source interactive long-horizon world model.☆852Aug 20, 2026Updated last week
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用 。☆64Jul 13, 2026Updated last month
- A full-stack monorepo project built with NestJS (backend) and React (admin dashboard) 🚀 一个基于 NestJS 后端与 React 后台管理系统的全栈 Monorepo 项目☆356Mar 18, 2026Updated 5 months ago
- polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket …☆189Updated this week
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆1,111Jul 31, 2026Updated last month
- web3 wallet: WalletConnect Monorepo☆176Aug 15, 2026Updated 2 weeks ago
- 从零到工作流，掌握 AstronClaw（云端）与 Loomy（桌面）的 AI 助手实战教程 | A complete tutorial to master AstronClaw (cloud AI) & Loomy (desktop AI)☆390Updated this week
- Rank-gap statistics for exploring high-dimensional overlap☆363Jan 6, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An Open-Source Algorithm Library of Point Cloud Quality Assessment based on Deep Learning☆179Jun 20, 2026Updated 2 months ago
- ☆1,252Jul 7, 2026Updated last month
- Unified CLI for local skills, external CLIs, and terminal AI chat.☆298Jul 22, 2026Updated last month
- Compile your documents into a local, linked, LLM-maintained wiki.☆37Jun 9, 2026Updated 2 months ago
- HTTP, HTTPS, Websocket debugging proxy☆309May 23, 2026Updated 3 months ago
- "Aurogen🍊: The Multi-Agent Evolution of OpenClaw."☆606Mar 21, 2026Updated 5 months ago
- Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation☆79Jun 7, 2026Updated 2 months ago
- A domain-specific language (DSL) based on Triton but providing higher-level abstractions.☆305Updated this week
- Codex skill for design-system-first frontend UI implementation☆158Jun 27, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PHP backdoor detector is a Python toolkit that helps you find malicious hidden suspicious PHP scripts and shells in your site files.☆196Jan 4, 2026Updated 7 months ago
- This is a web version of the discord cleaner.☆234Mar 29, 2026Updated 5 months ago
- Repo for "Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content"☆65Jun 9, 2025Updated last year
- hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyperliquid hyper…☆232Updated this week
- BRFv4 - HTML5/Javascript - examples project. Reference implementation for all other platform example packages.☆308Aug 13, 2025Updated last year
- Remote control for Claude Code, Codex, Grok, and Cursor on Mac or PC. View sessions, send tasks, and drive them remotely from your phone,…☆1,034Aug 19, 2026Updated last week
- ☆200Jul 13, 2026Updated last month