Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆22Jul 19, 2026Updated 3 months ago
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆55Sep 1, 2026Updated last month
- The agent that remembers and learns.☆2,227Jul 18, 2026Updated 3 months ago
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆3,028Updated this week
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆138Updated this week
- Agent Exploration Toward Artificial General Intelligence: A Survey☆48Aug 14, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆666Aug 12, 2026Updated 2 months ago
- Remote control for Claude Code, Codex, Grok, and Cursor on Mac or PC. View sessions, send tasks, and drive them remotely from your phone,…☆2,104Updated this week
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用。☆45Jul 13, 2026Updated 3 months ago
- The SDK for Jetpac's iOS Deep Belief image recognition framework☆291Aug 14, 2025Updated last year
- Open-source, local-first desktop AI research workbench for scientific computing with Python/R, MCP bioinformatics tools, SSH/WSL/GPU runt…☆1,059Updated this week
- ☆1,331Jul 24, 2026Updated 3 months ago
- A domain-specific language (DSL) based on Triton but providing higher-level abstractions.☆435Updated this week
- Repo for "Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content"☆63Jun 9, 2025Updated last year
- BRFv4 - HTML5/Javascript - examples project. Reference implementation for all other platform example packages.☆311Aug 13, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Open, lightweight multimodal decision models for text, images, and video. Train and run them yourself.☆893Updated this week
- ☆402Updated this week
- Jev DSH 决策引擎｜面向 Agent Harness 的结构化决策插件。原生支持 DeepSeek Harness，通过 iPolloWork 支持 OpenCode、Codex Harness。☆267Sep 20, 2026Updated last month
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆959Sep 28, 2026Updated last month
- HTTP, HTTPS, Websocket debugging proxy☆279Sep 2, 2026Updated last month
- Evidence-driven Agent Skills for design award research, evaluation, award matching, entry writing, and submission readiness.☆711Aug 24, 2026Updated 2 months ago
- ☆69Jul 11, 2026Updated 3 months ago
- Search-Then-Verify natural language querying over time series databases (ICML 2026). Includes NLQTSBench.☆80Oct 12, 2026Updated 2 weeks ago
- Learning, practice, and research projects from my master's program in Applied Information Technology.☆16Oct 19, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Compile your documents into a local, linked, LLM-maintained wiki.☆28Jun 9, 2026Updated 4 months ago
- Bounded, typed, ablatable memory contract for long-horizon LLM agents — Slay the Spire 2 testbed☆113Jul 3, 2026Updated 3 months ago
- ☆15Apr 9, 2026Updated 6 months ago
- Map the best way into any topic. 规划任何主题的最佳学习路径。☆200Aug 17, 2026Updated 2 months ago
- SDK for integrating with newtype-ai.org — verify agent identity with one function call☆72May 1, 2026Updated 5 months ago
- 蒸馏你的老师 —— 把老师的教学方式、性格特点和学科知识提取成 AI 技能文件，让 AI 像你的老师一样给你讲题。Inspired by colleague-skill（同事skill）。☆97Apr 6, 2026Updated 6 months ago
- Human-in-the-loop planning extension for the Pi coding agent. Turns rough change requests into versioned Markdown plans, stores them in a…☆239Oct 11, 2026Updated 2 weeks ago
- hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy hyperliquid copy h…☆160Sep 18, 2026Updated last month
- Your AI usage, quota, and balance — as a desk pet. 🐾 A local companion service that normalizes every AI provider into one LAN feed, plus…☆105Jun 30, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Open source AI company OS. 38 roles, 6 templates, 4-layer memory. Your AI company remembers everything — locally. npx clawcompany☆488Apr 25, 2026Updated 6 months ago
- ☆22Mar 5, 2026Updated 7 months ago
- Codex skill for design-system-first frontend UI implementation☆106Jun 27, 2026Updated 4 months ago
- OneEval: Open EvalScope evaluation artifacts for LLMs — subset breakdowns, pass@k curves, and reproducible evaluation protocols.☆28Mar 4, 2026Updated 7 months ago
- The generic genome-scale metabolic model of Homo sapiens☆174Updated this week
- solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trading bot | solana trad…☆193Oct 9, 2026Updated 3 weeks ago
- An Open-Source Algorithm Library of Point Cloud Quality Assessment based on Deep Learning☆195Jun 20, 2026Updated 4 months ago