A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.
☆164Jan 12, 2026Updated last month
Alternatives and similar repositories for torchsnapshot
Users that are interested in torchsnapshot are comparing it to the libraries listed below
Sorting:
- Torch Distributed Experimental☆117Aug 5, 2024Updated last year
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆66Mar 21, 2022Updated 3 years ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆417Updated this week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆179Dec 16, 2025Updated 2 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,249Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆226Aug 1, 2024Updated last year
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,075Apr 17, 2024Updated last year
- A library to analyze PyTorch traces.☆467Feb 4, 2026Updated last month
- Pipeline Parallelism for PyTorch☆785Aug 21, 2024Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆478Feb 3, 2026Updated last month
- TensorDict is a pytorch dedicated tensor container.☆1,009Updated this week
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆52Feb 25, 2026Updated last week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆248Feb 12, 2026Updated 2 weeks ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆927Updated this week
- ☆251Jul 25, 2024Updated last year
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆1,014Feb 23, 2026Updated last week
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆340Updated this week
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- High performance model preprocessing library on PyTorch☆647Mar 29, 2024Updated last year
- TorchFix - a linter for PyTorch-using code with autofix support☆152Aug 23, 2025Updated 6 months ago
- A tracing JIT compiler for PyTorch☆13Dec 11, 2021Updated 4 years ago
- Causal Analysis of Agent Behavior for AI Safety☆20Jun 27, 2023Updated 2 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,436Aug 21, 2025Updated 6 months ago
- A resilient distributed training framework☆97Apr 11, 2024Updated last year
- ☆26Aug 31, 2023Updated 2 years ago
- Resource-adaptive cluster scheduler for deep learning training.☆454Mar 5, 2023Updated 3 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆439Updated this week
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- ☆15Apr 20, 2022Updated 3 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆284Dec 17, 2025Updated 2 months ago
- depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.☆790Oct 13, 2025Updated 4 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆327Updated this week
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- PyTorch native quantization and sparsity for training and inference☆2,707Updated this week
- ☆107Apr 15, 2021Updated 4 years ago
- Ring attention implementation with flash attention☆986Sep 10, 2025Updated 5 months ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Jan 30, 2026Updated last month
- ☆25Apr 13, 2021Updated 4 years ago
- Named tensors with first-class dimensions for PyTorch☆332Jun 14, 2023Updated 2 years ago