facebookresearch / HolisticTraceAnalysis
A library to analyze PyTorch traces.
☆370Updated this week
Alternatives and similar repositories for HolisticTraceAnalysis
Users that are interested in HolisticTraceAnalysis are comparing it to the libraries listed below
Sorting:
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆159Updated this week
- Applied AI experiments and examples for PyTorch☆265Updated 2 weeks ago
- Zero Bubble Pipeline Parallelism☆389Updated last week
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 9 months ago
- Pipeline Parallelism for PyTorch☆765Updated 8 months ago
- ☆204Updated 2 weeks ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆157Updated 5 months ago
- Distributed Triton for Parallel Systems☆677Updated last week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆195Updated this week
- Cataloging released Triton kernels.☆221Updated 4 months ago
- ☆166Updated 10 months ago
- ☆202Updated 10 months ago
- An open-source efficient deep learning framework/compiler, written in python.☆698Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆299Updated this week
- Perplexity GPU Kernels☆281Updated 2 weeks ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆808Updated this week
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆324Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆324Updated this week
- PyTorch per step fault tolerance (actively under development)☆300Updated this week
- Implementation of a Transformer, but completely in Triton☆265Updated 3 years ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆536Updated this week
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆349Updated this week
- extensible collectives library in triton☆86Updated last month
- Dynamic Memory Management for Serving LLMs without PagedAttention☆366Updated 3 weeks ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆132Updated this week
- Research and development for optimizing transformers☆126Updated 4 years ago
- ☆250Updated 9 months ago
- Microsoft Collective Communication Library☆345Updated last year
- A GPU performance profiling tool for PyTorch models☆504Updated 3 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆257Updated 2 years ago