pytorch / kineto
A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
☆755Updated last week
Alternatives and similar repositories for kineto:
Users that are interested in kineto are comparing it to the libraries listed below
- Pipeline Parallelism for PyTorch☆736Updated 4 months ago
- A library to analyze PyTorch traces.☆323Updated last month
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,016Updated 9 months ago
- A GPU performance profiling tool for PyTorch models☆500Updated 3 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆895Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆336Updated last week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆152Updated last month
- An open-source efficient deep learning framework/compiler, written in python.☆668Updated this week
- depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.☆550Updated last month
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆224Updated last month
- common in-memory tensor structure☆930Updated 3 months ago
- Tutel MoE: An Optimized Mixture-of-Experts Implementation☆746Updated this week
- A tensor-aware point-to-point communication primitive for machine learning☆252Updated 2 years ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,086Updated this week
- Implementation of a Transformer, but completely in Triton☆251Updated 2 years ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆179Updated last month
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,240Updated this week
- Running BERT without Padding☆468Updated 2 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- Microsoft Automatic Mixed Precision Library☆549Updated 3 months ago
- Accelerate PyTorch models with ONNX Runtime☆358Updated 4 months ago
- NCCL Tests☆967Updated 2 weeks ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆972Updated 3 months ago
- Zero Bubble Pipeline Parallelism☆309Updated 2 months ago
- ☆154Updated 7 months ago
- Profiling and inspecting memory in pytorch☆1,038Updated 5 months ago
- PyTorch RFCs (experimental)☆131Updated 4 months ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆446Updated this week
- functorch is JAX-like composable function transforms for PyTorch.☆1,403Updated this week
- Provide Python access to the NVML library for GPU diagnostics☆223Updated last month