Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.
☆22Jul 19, 2026Updated 4 months ago
Alternatives and similar repositories for llm-inference-optimization-lab
Users that are interested in llm-inference-optimization-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Chrome browser plugin that quickly brings web content into Figma, suitable for reference analysis, partial redesign, and interface reus…☆56Sep 1, 2026Updated 2 months ago
- Jev DSH 决策引擎|面向 Agent Harness 的结构化决策插件。原生支持 DeepSeek Harness,通过 iPolloWork 支持 OpenCode、Codex Harness。☆274Sep 20, 2026Updated 2 months ago
- The agent that remembers and learns.☆2,418Jul 18, 2026Updated 4 months ago
- ☆1,325Jul 24, 2026Updated 3 months ago
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆3,199Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate w…☆928Updated this week
- Remote control for Claude Code, Codex, Grok, and Cursor on Mac or PC. View sessions, send tasks, and drive them remotely from your phone.…☆2,377Updated this week
- 有情绪的 AI 桌面伴侣 | 隐私优先 · 语音唤醒 · 协助办公 · MCP 无限扩展 | An AI desktop companion with emotions — privacy-first, voice wake, office assistance, and …☆670Aug 12, 2026Updated 3 months ago
- ☆441Updated this week
- Evidence-driven Agent Skills for design award research, evaluation, award matching, entry writing, and submission readiness.☆708Aug 24, 2026Updated 2 months ago
- The SDK for Jetpac's iOS Deep Belief image recognition framework☆289Aug 14, 2025Updated last year
- Open-source, local-first desktop AI research workbench for scientific computing with Python/R, MCP bioinformatics tools, SSH/WSL/GPU runt…☆1,079Updated this week
- Independent native Design (including PPT) and Video plugins for DeepSeek Harness.☆1,872Updated this week
- A domain-specific language (DSL) based on Triton but providing higher-level abstractions.☆471Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Open-source Telegram server implementation / MTProto server in Go for Telegram Desktop, Android, Web, bots, calls, media, and self-hosted…☆144Updated this week
- a cross-platform screen casting & control software supporting group control and automated tasks(一款跨平台的移动端屏幕投屏、控制、群控和自动化脚本工具).☆576Jul 27, 2026Updated 3 months ago
- Agent Exploration Toward Artificial General Intelligence: A Survey☆48Aug 14, 2026Updated 3 months ago
- 把 Codex / Petdex 宠物包变成不依赖 Codex 的独立桌宠应用。☆45Jul 13, 2026Updated 4 months ago
- Repo for "Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content"☆64Jun 9, 2025Updated last year
- Map the best way into any topic. 规划任何主题的最佳学习路径。☆200Aug 17, 2026Updated 3 months ago
- Human-in-the-loop planning extension for the Pi coding agent. Turns rough change requests into versioned Markdown plans, stores them in a…☆237Oct 11, 2026Updated last month
- BRFv4 - HTML5/Javascript - examples project. Reference implementation for all other platform example packages.☆311Aug 13, 2025Updated last year
- Model-neutral AI workspace for macOS with multi-provider models, extensible tools, and inspectable deliverables.☆180Sep 30, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A unified multimodal model toolkit (NeurIPS'26)☆591Oct 29, 2026Updated 3 weeks ago
- An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.☆956Sep 28, 2026Updated last month
- HTTP, HTTPS, Websocket debugging proxy☆279Sep 2, 2026Updated 2 months ago
- A WordPress plugin to display 500px photo streams.☆13Oct 8, 2015Updated 11 years ago
- dat release☆148Aug 6, 2026Updated 3 months ago
- ☆1,190Jul 7, 2026Updated 4 months ago
- Learning, practice, and research projects from my master's program in Applied Information Technology.☆15Oct 19, 2025Updated last year
- Search-Then-Verify natural language querying over time series databases (ICML 2026). Includes NLQTSBench.☆81Oct 12, 2026Updated last month
- An enterprise collaboration platform for people and multi-agent teams, built on the open-source DeepSeek Harness. Shared projects, plugin…☆7,510Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆15Apr 9, 2026Updated 7 months ago
- Compile your documents into a local, linked, LLM-maintained wiki.☆28Jun 9, 2026Updated 5 months ago
- SDK for integrating with newtype-ai.org — verify agent identity with one function call☆72May 1, 2026Updated 6 months ago
- 蒸馏你的老师 —— 把老师的教学方式、性格特点和学科知识提取成 AI 技能文件,让 AI 像你的老师一样给你讲题。Inspired by colleague-skill(同事skill)。☆101Apr 6, 2026Updated 7 months ago
- Your AI usage, quota, and balance — as a desk pet. 🐾 A local companion service that normalizes every AI provider into one LAN feed, plus…☆106Jun 30, 2026Updated 4 months ago
- Bounded, typed, ablatable memory contract for long-horizon LLM agents — Slay the Spire 2 testbed☆115Jul 3, 2026Updated 4 months ago
- 【正在进行IndexTTS2.5接入开发!即将上架完整演示视频】Dubbing studio for AIGC voice workflow based on IndexTTS2 and VoxCPM2。基于IndexTTS2和VoxCPM2的AIGC语音工作流配音室☆112Aug 12, 2026Updated 3 months ago
Are these results useful?