ruipeterpan / torch_profiler
Simple PyTorch profiler that combines DeepSpeed Flops Profiler and TorchInfo
☆11Updated 2 years ago
Alternatives and similar repositories for torch_profiler
Users that are interested in torch_profiler are comparing it to the libraries listed below
Sorting:
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆18Updated 2 years ago
- An Attention Superoptimizer☆21Updated 3 months ago
- An external memory allocator example for PyTorch.☆14Updated 3 years ago
- SOTA Learning-augmented Systems☆36Updated 2 years ago
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆26Updated 4 months ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Updated last year
- ☆19Updated 7 months ago
- Benchmark tests supporting the TiledCUDA library.☆16Updated 5 months ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- ☆24Updated last year
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Updated 5 months ago
- Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference☆18Updated 2 years ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆25Updated 3 months ago
- ☆16Updated 2 years ago
- ☆37Updated 2 years ago
- Debug print operator for cudagraph debugging☆10Updated 9 months ago
- A curated list for Efficient Large Language Models☆11Updated last year
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆14Updated 4 years ago
- Quantized Attention on GPU☆45Updated 5 months ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Updated 5 years ago
- ☆27Updated last year
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆25Updated 7 months ago
- Machine Learning System☆14Updated 5 years ago
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 5 months ago
- ☆34Updated 4 months ago
- Vector search with bounded performance.☆35Updated last year
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆44Updated last month
- ☆11Updated 4 years ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth☆17Updated last year