Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆31Jul 19, 2026Updated 2 months ago
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementations of Agent-as-a-Router: Agentic Model Routing for Coding Tasks.☆1,239Jun 29, 2026Updated 2 months ago
- The agent that remembers and learns.☆2,239Jul 18, 2026Updated 2 months ago
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆79Sep 1, 2026Updated 2 weeks ago
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆863Aug 12, 2026Updated last month
- Official Implementation of OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation☆272Jul 5, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four …☆227Jul 14, 2026Updated 2 months ago
- dat release☆224Aug 6, 2026Updated last month
- Your AI usage, quota, and balance — as a desk pet. 🐾 A local companion service that normalizes every AI provider into one LAN feed, plus…☆154Jun 30, 2026Updated 2 months ago
- Self-Supervised Deep Learning for Fisheye Image Rectification (pytorch implementation).☆459Aug 13, 2025Updated last year
- polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polym…☆274Aug 27, 2026Updated 3 weeks ago
- ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethe…☆253Jul 14, 2026Updated 2 months ago
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆2,688Updated this week
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆147Updated this week
- hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy h…☆232Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Official DIDA Hotel Booking MCP Server. 14-year travel tech data stack, 2M+ hotels at wholesale rates, 40+ LLM compatible. Free unlimited…☆82Sep 8, 2026Updated last week
- Full-stack open-source interactive long-horizon world model.☆882Aug 20, 2026Updated last month
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用。☆64Jul 13, 2026Updated 2 months ago
- A full-stack monorepo project built with NestJS (backend) and React (admin dashboard) 🚀 一个基于 NestJS 后端与 React 后台管理系统的全栈 Monorepo 项目☆356Mar 18, 2026Updated 6 months ago
- polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket kalshi polymarket …☆196Aug 25, 2026Updated 3 weeks ago
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆1,139Jul 31, 2026Updated last month
- web3 wallet: WalletConnect Monorepo☆175Aug 15, 2026Updated last month
- 从零到工作流，掌握 AstronClaw（云端）与 Loomy（桌面）的 AI 助手实战教程 | A complete tutorial to master AstronClaw (cloud AI) & Loomy (desktop AI)☆395Updated this week
- An Open-Source Algorithm Library of Point Cloud Quality Assessment based on Deep Learning☆207Jun 20, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Rank-gap statistics for exploring high-dimensional overlap☆480Jan 6, 2026Updated 8 months ago
- Compile your documents into a local, linked, LLM-maintained wiki.☆38Jun 9, 2026Updated 3 months ago
- Local-first CLI for agent skills, browser automation, knowledge bases, external CLIs, and terminal AI chat.☆325Sep 9, 2026Updated last week
- ☆1,419Jul 7, 2026Updated 2 months ago
- HTTP, HTTPS, Websocket debugging proxy☆309Sep 2, 2026Updated 2 weeks ago
- "Aurogen🍊: The Multi-Agent Evolution of OpenClaw."☆603Mar 21, 2026Updated 5 months ago
- Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation☆82Jun 7, 2026Updated 3 months ago
- A domain-specific language (DSL) based on Triton but providing higher-level abstractions.☆348Updated this week
- Codex skill for design-system-first frontend UI implementation☆158Jun 27, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- PHP backdoor detector is a Python toolkit that helps you find malicious hidden suspicious PHP scripts and shells in your site files.☆196Jan 4, 2026Updated 8 months ago
- polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polym…☆244Sep 3, 2026Updated 2 weeks ago
- Repo for "Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content"☆66Jun 9, 2025Updated last year
- ☆69Jul 11, 2026Updated 2 months ago
- BRFv4 - HTML5/Javascript - examples project. Reference implementation for all other platform example packages.☆405Aug 13, 2025Updated last year
- ☆200Jul 13, 2026Updated 2 months ago
- solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trad…☆219Aug 15, 2026Updated last month