A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.
☆164Jan 12, 2026Updated 2 months ago
Alternatives and similar repositories for torchsnapshot
Users that are interested in torchsnapshot are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Torch Distributed Experimental☆117Aug 5, 2024Updated last year
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆247Feb 12, 2026Updated last month
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,251Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆421Updated this week
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆55Mar 18, 2026Updated last week
- A library to analyze PyTorch traces.☆474Mar 17, 2026Updated last week
- Pipeline Parallelism for PyTorch☆785Aug 21, 2024Updated last year
- A storage solution for PyTorch tensors with distributed tensor support.☆64Updated this week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆179Dec 16, 2025Updated 3 months ago
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆343Mar 16, 2026Updated last week
- This repository contains the experimental PyTorch native float8 training UX☆226Aug 1, 2024Updated last year
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,078Apr 17, 2024Updated last year
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆934Updated this week
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆66Mar 21, 2022Updated 4 years ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆487Mar 17, 2026Updated last week
- TensorDict is a pytorch dedicated tensor container.☆1,015Updated this week
- Causal Analysis of Agent Behavior for AI Safety☆20Jun 27, 2023Updated 2 years ago
- ☆251Jul 25, 2024Updated last year
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆1,019Mar 18, 2026Updated last week
- High performance model preprocessing library on PyTorch☆648Mar 29, 2024Updated last year
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- A resilient distributed training framework☆97Apr 11, 2024Updated last year
- ☆27Aug 31, 2023Updated 2 years ago
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 3 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,437Aug 21, 2025Updated 7 months ago
- Resource-adaptive cluster scheduler for deep learning training.☆453Mar 5, 2023Updated 3 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆284Dec 17, 2025Updated 3 months ago
- PyTorch native quantization and sparsity for training and inference☆2,739Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆21Feb 8, 2026Updated last month
- TorchFix - a linter for PyTorch-using code with autofix support☆151Aug 23, 2025Updated 7 months ago
- ☆107Apr 15, 2021Updated 4 years ago
- Ring attention implementation with flash attention☆996Sep 10, 2025Updated 6 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆332Updated this week
- Named tensors with first-class dimensions for PyTorch☆332Jun 14, 2023Updated 2 years ago
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- ☆15Apr 20, 2022Updated 3 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆442Mar 13, 2026Updated last week
- PyTorch extensions for high performance and large scale training.☆3,404Apr 26, 2025Updated 10 months ago