☆70Jun 23, 2025Updated 8 months ago
Alternatives and similar repositories for NeuSight
Users that are interested in NeuSight are comparing it to the libraries listed below
Sorting:
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆12May 7, 2024Updated last year
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆34Feb 10, 2025Updated last year
- LLM Inference analyzer for different hardware platforms☆105Feb 17, 2026Updated 3 weeks ago
- ☆13May 8, 2025Updated 10 months ago
- Repository for compilation and cycle-accurate simulator for scale-out systolic arrays☆16Jan 4, 2023Updated 3 years ago
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆15Jul 17, 2025Updated 7 months ago
- A large-scale simulation framework for LLM inference☆545Jul 25, 2025Updated 7 months ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆14Sep 7, 2024Updated last year
- ☆15Apr 13, 2024Updated last year
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆57Jul 23, 2024Updated last year
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆77Oct 15, 2025Updated 4 months ago
- ☆13Mar 6, 2023Updated 3 years ago
- The official repository of ICCV 2025 paper "CATP-LLM: Empowering Large Language Models for Cost-Aware Tool Planning".☆18Nov 26, 2025Updated 3 months ago
- TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.☆20Sep 20, 2025Updated 5 months ago
- Simulating Distributed Training at Scale☆14Sep 15, 2025Updated 5 months ago
- ☆13Nov 1, 2021Updated 4 years ago
- This repository contains the results and code for the MLPerf™ Inference v1.1 benchmark.☆12Jul 24, 2025Updated 7 months ago
- [CF ’20] Verified Instruction-Level Energy Consumption Measurement for NVIDIA GPUs☆15Dec 11, 2020Updated 5 years ago
- A Postgres Extension to Manage Extensions! (As well as some random stuff)☆15May 31, 2023Updated 2 years ago
- Latency and Memory Analysis of Transformer Models for Training and Inference☆477Apr 19, 2025Updated 10 months ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆66Dec 11, 2025Updated 2 months ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆19Dec 8, 2023Updated 2 years ago
- LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure☆189Mar 1, 2026Updated last week
- Disaggregated serving system for Large Language Models (LLMs).☆778Apr 6, 2025Updated 11 months ago
- ☆18Apr 25, 2025Updated 10 months ago
- Pluggable in-process caching engine to build and scale high performance services☆18Mar 2, 2026Updated last week
- ☆17Mar 26, 2025Updated 11 months ago
- Dirigent: Lightweight Serverless Orchestration☆41Aug 26, 2025Updated 6 months ago
- TLB Benchmarks☆35Sep 11, 2017Updated 8 years ago
- ☆112Apr 19, 2024Updated last year
- ☆15Apr 20, 2022Updated 3 years ago
- MetaOpt: Towards efficient heuristic design with quantifiable and confident performance☆21Jan 20, 2026Updated last month
- GPU-accelerated LLM Training Simulator☆51Jun 26, 2025Updated 8 months ago
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆524Jan 3, 2026Updated 2 months ago
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆52Updated this week
- ☆44Jul 4, 2024Updated last year
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆29Feb 28, 2026Updated last week
- DeepSeek Native Sparse Attention pytorch implementation☆114Dec 17, 2025Updated 2 months ago
- ☆24Oct 30, 2024Updated last year