Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆23Jul 19, 2026Updated this week
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆120Updated this week
- The agent that remembers and learns.☆1,254Updated this week
- uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap arbitrage | uniswap sushiswap…☆354Updated this week
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆395Updated this week
- polymarket arbitrage polymarket arbitrage polymarket arbitrage polymarket arbitrage polymarket arbitrage polymarket arbitrage polymarket …☆365Jul 14, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- dat release☆273Updated this week
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆111Updated this week
- ☆372Jul 20, 2025Updated last year
- Official Implementation of OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation☆205Jul 5, 2025Updated last year
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用。☆68Jul 13, 2026Updated last week
- The official implementations of Agent-as-a-Router: Agentic Model Routing for Coding Tasks.☆808Jun 29, 2026Updated 3 weeks ago
- MNE-BIDS is a Python package that allows you to read and write BIDS-compatible datasets with the help of MNE-Python.☆181Aug 13, 2025Updated 11 months ago
- The most popular asynchronous Python API for BscScan (Binance Smart Chain Explorer), available via PyPI.☆171Aug 13, 2025Updated 11 months ago
- Self-Supervised Deep Learning for Fisheye Image Rectification (pytorch implementation).☆181Aug 13, 2025Updated 11 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆1,258Jul 10, 2026Updated last week
- Nukkit Plugin: Protect yourself from griefers by placing a protection block!☆172Jan 4, 2026Updated 6 months ago
- vet is a command-line tool that acts as a safety net for the risky curl | bash pattern. It lets you inspect, diff against previous versio…☆211Aug 13, 2025Updated 11 months ago
- Full-stack open-source interactive long-horizon world model.☆528Updated this week
- snippets for power users☆198Jan 4, 2026Updated 6 months ago
- ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethereum flashloan ethe…☆347Jul 14, 2026Updated last week
- Rank-gap statistics for exploring high-dimensional overlap☆201Jan 6, 2026Updated 6 months ago
- Haskell raw bindings to Oracle ODPI-C Library☆364Jun 28, 2026Updated 3 weeks ago
- ☆378Apr 7, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆191Jun 30, 2026Updated 3 weeks ago
- a cpp game engine for windows console and Linux terminal☆139Jan 5, 2026Updated 6 months ago
- Public slides and demo code of bypassing security protection in the latest Windows Internet Explorer.☆352Jun 30, 2026Updated 3 weeks ago
- bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four meme | bnb four …☆336Jul 14, 2026Updated last week
- wallet connect: WalletConnect Monorepo☆341Updated this week
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆1,097Jul 8, 2026Updated last week
- Repo for "Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content"☆73Jun 9, 2025Updated last year
- Bitcoin Explorer(esplora): Explorer for Bitcoin and Liquid V2☆347Updated this week
- An unofficial API handler to footballapi.pulselive.com. Permitted for study purposes only.☆169Jan 5, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- BRFv4 - HTML5/Javascript - examples project. Reference implementation for all other platform example packages.☆163Aug 13, 2025Updated 11 months ago
- A wearable terminal to dispatch tasks to your own AI agents — Claude Code, OpenClaw, Codex. Tap, speak, dispatch. The first hardware buil…☆191Jul 7, 2026Updated 2 weeks ago
- Accurate-Cyber-Defense-Assembly-Tool is a lightweight, high-performance cybersecurity utility developed using Assembly and C programming …☆171Jan 8, 2026Updated 6 months ago
- Only working youtube and rumble vews/watch bot with an API, GUI, likes, dislikes, comments, views and watch time☆180Aug 13, 2025Updated 11 months ago
- My portfolio inspired by FB Messenger. Built in React with Hooks and Context API.☆227Jan 5, 2026Updated 6 months ago
- pelican-svbhack is a responsive theme for Pelican and it is my hack of a svbtle-like theme☆183Feb 10, 2026Updated 5 months ago
- Library and tools to access the BitLocker Drive Encryption (BDE) encrypted volumes☆179Aug 13, 2025Updated 11 months ago