AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving cluster
☆88Oct 18, 2026Updated this week
Alternatives and similar repositories for aisimulate
Users that are interested in aisimulate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simulating Distributed Training at Scale☆17Sep 15, 2025Updated last year
- ☆16Feb 5, 2024Updated 2 years ago
- An agentic system that auto-optimizes LLM workloads on AMD GPUs.☆242Updated this week
- A collection of megakernels for TPU☆163Updated this week
- Network-faithful simulation of LLM serving and training deployments☆50Oct 8, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆185Updated this week
- Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping☆27Updated this week
- ☆21Jul 28, 2026Updated 2 months ago
- Offline optimization of your disaggregated Dynamo graph☆459Sep 18, 2026Updated last month
- MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts☆1,182Updated this week
- ☆17Aug 25, 2026Updated last month
- ☆164Oct 8, 2026Updated last week
- GPU kernel optimization framework☆32Sep 4, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Run:ai is the AI workload orchestration platform for Kubernetes. This monorepo contains the control plane services, in-cluster Kubernetes…☆483Updated this week
- Learning notes for understanding modern Machine Learning System.☆64Updated this week
- Communication patterns for AI, built on top of NCCL device and host APIs☆68Updated this week
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13Jul 11, 2026Updated 3 months ago
- GPU topology-aware scheduler☆13Jul 7, 2017Updated 9 years ago
- DeepStack: Facilitating Co-Design Exploration of 3D DRAM-Stacked Accelerators for Distributed LLM Inference. Includes the MICRO 2026 AE a…☆65Oct 5, 2026Updated last week
- Extremely Simple Microbenchmarks☆46May 23, 2018Updated 8 years ago
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆44Jul 22, 2026Updated 2 months ago
- Final Project for Parallel Computing at CMU (15-618/15-418)☆10May 13, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆216Updated this week
- ☆46Aug 3, 2026Updated 2 months ago
- caniuse.com, but for kubernetes☆27Dec 25, 2024Updated last year
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 9 months ago
- ☆54Updated this week
- Python Tools for the POP Metrics☆13Feb 16, 2022Updated 4 years ago
- A hybrid GPU cluster simulator for ML system performance estimation☆51Jul 15, 2026Updated 3 months ago
- A parser for PTX 6.5☆13Jun 19, 2023Updated 3 years ago
- Handwritten Digit Recognition Using Neural Network by Python☆11May 10, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆30Updated this week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- HCC Sample Applications☆13Jan 3, 2017Updated 9 years ago
- ☆38Aug 4, 2026Updated 2 months ago
- A cache reuse and bypass predictor for LLC using the perceptron learning algorithm. Based on Teran et al., MICRO 2016☆11Dec 7, 2017Updated 8 years ago
- d.run website☆18Updated this week
- Variant optimization autoscaler for distributed inference workloads☆60Updated this week