Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆43Jul 19, 2026Updated 3 weeks ago
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementations of Agent-as-a-Router: Agentic Model Routing for Coding Tasks.☆1,099Jun 29, 2026Updated last month
- The agent that remembers and learns.☆1,675Jul 18, 2026Updated 3 weeks ago
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆119Jul 16, 2026Updated 3 weeks ago
- uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap…☆354Jul 19, 2026Updated 3 weeks ago
- A more advanced free and open .NET obfuscator using dnlib.☆354Jun 30, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆689Jul 22, 2026Updated 2 weeks ago
- Official Implementation of OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation☆300Jul 5, 2025Updated last year
- bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four …☆334Jul 14, 2026Updated 3 weeks ago
- Self-Supervised Deep Learning for Fisheye Image Rectification (pytorch implementation).☆292Aug 13, 2025Updated 11 months ago
- blockchain extension | web3 extension | extension: Taho, the community owned and operated Web3 wallet.☆376Jul 24, 2026Updated 2 weeks ago
- ☆192Jun 30, 2026Updated last month
- dat release☆273Updated this week
- snippets for power users☆311Jan 4, 2026Updated 7 months ago
- ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethe…☆349Jul 14, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- wallet connect: WalletConnect Monorepo☆340Jul 21, 2026Updated 3 weeks ago
- My portfolio inspired by FB Messenger. Built in React with Hooks and Context API.☆354Jan 5, 2026Updated 7 months ago
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆1,724Jul 10, 2026Updated last month
- MNE-BIDS is a Python package that allows you to read and write BIDS-compatible datasets with the help of MNE-Python.☆228Aug 13, 2025Updated 11 months ago
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆148Updated this week
- solana pumpfun solana pumpfun solana pumpfun solana pumpfun solana pumpfun solana pumpfun solana pumpfun solana pumpfun solana pumpfun so…☆351Updated this week
- Nukkit Plugin: Protect yourself from griefers by placing a protection block!☆264Jan 4, 2026Updated 7 months ago
- Bitcoin Explorer(esplora): Explorer for Bitcoin and Liquid V2☆347Jul 19, 2026Updated 3 weeks ago
- Official DIDA Hotel Booking MCP Server. 14-year travel tech data stack, 2M+ hotels at wholesale rates, 40+ LLM compatible. Free unlimited…☆93Aug 4, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Full-stack open-source interactive long-horizon world model.☆853Jul 31, 2026Updated last week
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用。☆75Jul 13, 2026Updated 3 weeks ago
- A full-stack monorepo project built with NestJS (backend) and React (admin dashboard) 🚀 一个基于 NestJS 后端与 React 后台管理系统的全栈 Monorepo 项目☆391Mar 18, 2026Updated 4 months ago
- btc | bitcoin | bitcoin rpc | bitcoin core | bticoin explorer - Database-free, self-hosted Bitcoin explorer, via RPC to Bitcoin Core.☆345Jul 16, 2026Updated 3 weeks ago
- a cpp game engine for windows console and Linux terminal☆214Jan 5, 2026Updated 7 months ago
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆1,096Jul 31, 2026Updated last week
- Blackjack for FiveM, very close to GTA Online.☆258Aug 13, 2025Updated 11 months ago
- The most popular asynchronous Python API for BscScan (Binance Smart Chain Explorer), available via PyPI.☆221Aug 13, 2025Updated 11 months ago
- 从零到工作流，掌握 AstronClaw（云端）与 Loomy（桌面）的 AI 助手实战教程 | A complete tutorial to master AstronClaw (cloud AI) & Loomy (desktop AI)☆425Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Accurate-Cyber-Defense-Assembly-Tool is a lightweight, high-performance cybersecurity utility developed using Assembly and C programming …☆265Jan 8, 2026Updated 7 months ago
- vet is a command-line tool that acts as a safety net for the risky curl | bash pattern. It lets you inspect, diff against previous versio…☆239Aug 13, 2025Updated 11 months ago
- polymarket arbitrage | polymarket arbitrage | polymarket arbitrage | polymarket arbitrage | polymarket arbitrage | polymarket arbitrage |…☆232Updated this week
- Rank-gap statistics for exploring high-dimensional overlap☆312Jan 6, 2026Updated 7 months ago
- An Open-Source Algorithm Library of Point Cloud Quality Assessment based on Deep Learning☆205Jun 20, 2026Updated last month
- polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polymarket polym…☆226Updated this week
- Incremental implementation of NJW algorithm presented in paper "On Spectral Clustering: Analysis and an algorithm" using Eigenvalue Pertu…☆236Aug 13, 2025Updated 11 months ago