topal-team / rockmate
☆36Updated 4 months ago
Alternatives and similar repositories for rockmate:
Users that are interested in rockmate are comparing it to the libraries listed below
- Sparsity support for PyTorch☆34Updated last month
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- ☆10Updated 3 years ago
- Experiment of using Tangent to autodiff triton☆78Updated last year
- A library for unit scaling in PyTorch☆125Updated 4 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆174Updated 11 months ago
- ☆40Updated 9 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆111Updated last week
- pytorch-profiler☆51Updated last year
- ☆103Updated 8 months ago
- ☆29Updated last year
- ☆157Updated last year
- ☆24Updated 5 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 9 months ago
- Butterfly matrix multiplication in PyTorch☆169Updated last year
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆30Updated 2 years ago
- A bunch of kernels that might make stuff slower 😉☆34Updated this week
- Research and development for optimizing transformers☆125Updated 4 years ago
- extensible collectives library in triton☆85Updated 3 weeks ago
- ☆38Updated last year
- ☆43Updated last year
- ☆40Updated 3 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- ☆163Updated 10 months ago
- ☆42Updated 2 years ago
- This repository contains the experimental PyTorch native float8 training UX☆223Updated 8 months ago
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- PyTorch bindings for CUTLASS grouped GEMM.☆81Updated 5 months ago
- ☆78Updated 5 months ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆108Updated 4 months ago