Frontier: A Discrete-Event Simulator for Modern LLM Serving
☆167Oct 22, 2026Updated this week
Alternatives and similar repositories for Frontier
Users that are interested in Frontier are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simulating Distributed Training at Scale☆17Sep 15, 2025Updated last year
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆24Aug 5, 2026Updated 2 months ago
- ☆130Updated this week
- LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure☆435Updated this week
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13Jul 11, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Accurate, large-scale, and extensible simulator for LLM inference Systems☆706Aug 24, 2026Updated last month
- An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.☆37Jul 21, 2026Updated 3 months ago
- ☆27Oct 1, 2025Updated last year
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- ☆98Feb 5, 2026Updated 8 months ago
- ☆116Aug 5, 2026Updated 2 months ago
- An Open Compiler Harness for Agentic GPU Programming☆165Updated this week
- ☆38Oct 17, 2026Updated last week
- ☆38Aug 4, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆46Oct 15, 2025Updated last year
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆79Mar 11, 2026Updated 7 months ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆33Aug 6, 2026Updated 2 months ago
- Production-ready MoE load balancing via real-time expert replication☆258Oct 15, 2026Updated last week
- The agent flow system for token maxxing.☆339Updated this week
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 7 months ago
- Tutti is a GPU-centric KV Cache Store to make SSD work as DRAM.☆64Oct 14, 2026Updated last week
- Real-time statusline HUD for OpenAI Codex CLI - Monitor sessions, context usage, git status, and tool activity☆79Oct 6, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆19Aug 2, 2026Updated 2 months ago
- A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages☆201Updated this week
- DeepStack: Facilitating Co-Design Exploration of 3D DRAM-Stacked Accelerators for Distributed LLM Inference. Includes the MICRO 2026 AE a…☆65Oct 5, 2026Updated 2 weeks ago
- TensorIR is a lightweight NVIDIA-owned MLIR compiler frontend for expressing tensor computations and lowering them to NVIDIA CUDA Tile IR…☆138Oct 15, 2026Updated last week
- A Lightweight LLM Inference Performance Simulator☆103Updated this week
- A framework for generating realistic LLM serving workloads☆183Aug 27, 2026Updated last month
- A model-agnostic GPU runtime for shipping models as verified programs.☆132Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Modified for AMD MI50 GPUs | A high-throughput and memory-efficient inference and serving engine for LLMs☆15Mar 2, 2026Updated 7 months ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 6 months ago
- [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…☆22Jun 19, 2026Updated 4 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆296Updated this week
- Minimal agent harness in one Bash file. One-line quick start. Bootloader agent for bare-metal servers.☆23Sep 15, 2026Updated last month
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆268Updated this week
- An open, visual atlas of looped transformers, recurrent computation, adaptive depth, and latent reasoning.☆33Sep 26, 2026Updated 3 weeks ago