microsoft / tensorflow-rematerialization
Implementation of a Tensorflow XLA rematerialization pass
☆15Updated 5 years ago
Alternatives and similar repositories for tensorflow-rematerialization:
Users that are interested in tensorflow-rematerialization are comparing it to the libraries listed below
- Distributed ML Optimizer☆30Updated 3 years ago
- benchmarking some transformer deployments☆26Updated last year
- A library for syntactically rewriting Python programs, pronounced (sinner).☆70Updated 3 years ago
- DLPack for Tensorflow☆36Updated 4 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- Make triton easier☆47Updated 9 months ago
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆28Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- ☆12Updated 3 years ago
- A tracing JIT compiler for PyTorch☆13Updated 3 years ago
- a high performance system for customized-precision distributed deep learning☆12Updated 4 years ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 5 months ago
- Runtime Tracing Library for TensorFlow☆43Updated 6 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- ☆38Updated last year
- This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.☆56Updated last year
- extensible collectives library in triton☆83Updated 5 months ago
- ☆21Updated 2 weeks ago
- Standalone pre-training recipe with JAX+Flax☆31Updated last year
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 2 months ago
- Experiment of using Tangent to autodiff triton☆76Updated last year
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- PyTorch centric eager mode debugger☆46Updated 3 months ago
- An experimental ahead of time compiler for Relay.☆50Updated 4 years ago
- ☆21Updated 2 years ago
- ☆51Updated 7 months ago
- ☆33Updated 4 years ago
- ☆44Updated last year
- Codebase associated with the PyTorch compiler tutorial☆46Updated 5 years ago