Frontier: A Discrete-Event Simulator for Modern LLM Serving
☆68Jul 6, 2026Updated last week
Alternatives and similar repositories for Frontier
Users that are interested in Frontier are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simulating Distributed Training at Scale☆14Sep 15, 2025Updated 9 months ago
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13May 17, 2025Updated last year
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- ☆27Oct 1, 2025Updated 9 months ago
- Paper list for accleration of transformers☆14Jul 1, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ML kernels and benchmarking infrastructure written in TIRx☆65Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆31Updated this week
- Asynchronous pipeline parallel optimization☆22Feb 2, 2026Updated 5 months ago
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆75Mar 11, 2026Updated 4 months ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆35May 22, 2026Updated last month
- The ASPLOS 2025 / EuroSys 2025 Contest Track☆41Jun 4, 2026Updated last month
- Metis: File System Model Checking via Versatile Input and State Exploration (FAST '24)☆16Mar 18, 2025Updated last year
- ☆31Updated this week
- Tensara's GPU programming problems☆20Apr 23, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 5 months ago
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆93Oct 15, 2025Updated 8 months ago
- Autonomous CUDA kernel optimization agent with structured task specs and per-config scoring☆17Jun 17, 2026Updated 3 weeks ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆133Jun 24, 2025Updated last year
- Composable and Embeddable Communication Runtime for Distributed AI Services☆102Jun 5, 2026Updated last month
- ☆119Mar 23, 2026Updated 3 months ago
- NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across speci…☆37Updated this week
- Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.☆68Mar 4, 2026Updated 4 months ago
- [Accepted to SOSP 2026] Fast Deterministic LLM Inference☆21Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Accepted to MLSys 2026☆91Apr 19, 2026Updated 2 months ago
- eBPF for GPU UVM offloading and scheduling in Linux kernel☆59Apr 15, 2026Updated 2 months ago
- Accurate, large-scale, and extensible simulator for LLM inference Systems☆641Jul 25, 2025Updated 11 months ago
- Share your GPU without MIG or MPS☆50Jan 27, 2026Updated 5 months ago
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆16Jan 16, 2026Updated 5 months ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- ☆16Aug 18, 2022Updated 3 years ago
- This is the implementation repository of our SOSP'24 paper: Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value …☆24Oct 20, 2024Updated last year
- ☆19Nov 18, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆114Dec 2, 2025Updated 7 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.☆45Updated this week
- ☆82Feb 5, 2026Updated 5 months ago
- KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels☆34Jun 1, 2026Updated last month
- mKernel: fast multi-node, multi-GPU fused kernels☆251Jun 21, 2026Updated 3 weeks ago
- ☆22Dec 8, 2022Updated 3 years ago