topal-team / rockmate
☆34Updated last month
Alternatives and similar repositories for rockmate:
Users that are interested in rockmate are comparing it to the libraries listed below
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 10 months ago
- ☆11Updated 2 years ago
- Sparsity support for PyTorch☆33Updated last month
- ☆96Updated 4 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆75Updated this week
- Experiment of using Tangent to autodiff triton☆74Updated 11 months ago
- ☆23Updated 2 months ago
- pytorch-profiler☆50Updated last year
- extensible collectives library in triton☆76Updated 3 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 6 months ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆31Updated last year
- Customized matrix multiplication kernels☆53Updated 2 years ago
- A block oriented training approach for inference time optimization.☆32Updated 5 months ago
- ☆154Updated 7 months ago
- A library for unit scaling in PyTorch☆118Updated last month
- Distributed K-FAC Preconditioner for PyTorch☆84Updated this week
- Fast Hadamard transform in CUDA, with a PyTorch interface☆133Updated 7 months ago
- ☆27Updated 3 weeks ago
- ☆64Updated 2 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 2 years ago
- ☆43Updated 11 months ago
- Official implementation of Neurips 2020 "Sparse Weight Activation Training" paper.☆27Updated 3 years ago
- ☆30Updated 5 months ago
- The simplest but fast implementation of matrix multiplication in CUDA.☆34Updated 5 months ago
- Collection of kernels written in Triton language☆90Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆187Updated last week
- Personal solutions to the Triton Puzzles☆18Updated 6 months ago
- ☆27Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆58Updated 2 months ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 3 years ago