vLLM wall-clock emulation pluging to allow running the real vllm serve and benchmark without gpu with simple mocking
☆17Aug 21, 2026Updated 3 months ago
Alternatives and similar repositories for llm-emu
Users that are interested in llm-emu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM serving simulator that uses DoolyProf's latency database; built around the vLLM's native scheduler.☆15Oct 28, 2026Updated 3 weeks ago
- Energy and carbon-aware extension of Vidur for sustainable LLM inference simulation and analysis 💡🌳☆11Sep 10, 2025Updated last year
- [ICML 2025] Adaptive Self-improvement LLM Agentic System for ML Library Development☆17Jan 6, 2026Updated 10 months ago
- [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…☆22Jun 19, 2026Updated 5 months ago
- Official code repository for "Neo: Real-Time On-Device 3D Gaussian Splatting with Reuse-and-Update Sorting Acceleration [ASPLOS’26]"☆16Dec 14, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆25Nov 6, 2026Updated 2 weeks ago
- Surrogate-based Hyperparameter Tuning System☆30Jun 29, 2023Updated 3 years ago
- ☆24Aug 15, 2023Updated 3 years ago
- Code release for AdapMoE accepted by ICCAD 2024☆40Apr 28, 2025Updated last year
- ☆35Jul 28, 2026Updated 3 months ago
- su su su supernova☆24Jan 9, 2025Updated last year
- [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…☆18Feb 4, 2025Updated last year
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated last year
- Professional StagingFramework stagingframework-engine with StagingFramework-optimized scalable-architecture and enterprise enterprise-gra…☆11Aug 3, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The wafer-native AI accelerator simulation platform and inference engine.☆69Jan 1, 2026Updated 10 months ago
- App built with lang-chain utilizing OpenAI API to generate cool pet names based on the animal type and color.☆12Feb 3, 2024Updated 2 years ago
- ☆10Dec 7, 2024Updated last year
- one-year LLM serving trace from Chutes☆42Oct 17, 2026Updated last month
- A Codex skill for evidence-grounded paper reading, reusable academic writing, literature synthesis, and research co-creation. 论文深读、写作迁移与研…☆15Oct 26, 2026Updated 3 weeks ago
- 作文数据集 - 第 1 部分☆15Apr 9, 2020Updated 6 years ago
- ☆14Jul 19, 2020Updated 6 years ago
- ☆14Aug 6, 2025Updated last year
- Network-Accelerated Distributed Deep Learning☆10Sep 13, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An exploration of distributed processing solutions for MLOps.☆12Feb 17, 2025Updated last year
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆34Mar 7, 2024Updated 2 years ago
- ☆30Nov 9, 2026Updated last week
- WASM based playground for MiniJinja☆18Mar 15, 2026Updated 8 months ago
- MicroView (USENIX NSDI'26) is a cloud-native observability system that leverages FDSketch and IPUs (SmartNICs) to accelerate collection, …☆15May 17, 2026Updated 6 months ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 5 months ago
- An Efficient Dynamic Resource Scheduler for Deep Learning Clusters☆41Oct 28, 2017Updated 9 years ago
- ☆13Jul 29, 2025Updated last year
- Cache Me, Catch You: Cache Related Security Threats in LLM Serving Frameworks (NDSS 2026)☆22Dec 18, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Serverless Paper Reading and Discussion☆37Jan 9, 2023Updated 3 years ago
- Professional BetaProtocol framework with BetaProtocol-optimized enterprise-grade and enterprise betaprotocol-optimization capabilities☆11Aug 3, 2025Updated last year
- A Deep Learning Cluster Scheduler☆36Jan 11, 2021Updated 5 years ago
- ☆12May 11, 2025Updated last year
- ARS: Automatic Routing Solver with Large Language Models☆12Dec 11, 2025Updated 11 months ago
- A list of papers for Graph Retrieval-Augmented Generation (GraphRAG).☆10Mar 13, 2025Updated last year
- ☆15Jun 10, 2026Updated 5 months ago
Are these results useful?