topal-team / rockmate
☆36Updated 3 months ago
Alternatives and similar repositories for rockmate:
Users that are interested in rockmate are comparing it to the libraries listed below
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated last year
- Sparsity support for PyTorch☆35Updated last week
- Fast Hadamard transform in CUDA, with a PyTorch interface☆154Updated 10 months ago
- ☆10Updated 3 years ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆104Updated this week
- ☆29Updated last year
- A library for unit scaling in PyTorch☆124Updated 4 months ago
- ☆38Updated 8 months ago
- Experiment of using Tangent to autodiff triton☆78Updated last year
- Collection of kernels written in Triton language☆117Updated last month
- PyTorch bindings for CUTLASS grouped GEMM.☆77Updated 5 months ago
- ☆102Updated 7 months ago
- ☆53Updated last year
- ☆67Updated 2 months ago
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- ☆73Updated 4 months ago
- extensible collectives library in triton☆84Updated 6 months ago
- ☆24Updated 4 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 8 months ago
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆30Updated last year
- ☆202Updated 2 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 3 years ago
- ☆43Updated last year
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- ☆27Updated 2 months ago
- ☆163Updated 9 months ago
- ☆24Updated 8 months ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆107Updated 3 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- This repository contains the experimental PyTorch native float8 training UX☆222Updated 8 months ago