HazyResearch / butterfly
Butterfly matrix multiplication in PyTorch
☆160Updated 11 months ago
Related projects: ⓘ
- Block-sparse primitives for PyTorch☆147Updated 3 years ago
- Distributed K-FAC Preconditioner for PyTorch☆75Updated last week
- Structured matrices for compressing neural networks☆65Updated 11 months ago
- JMP is a Mixed Precision library for JAX.☆183Updated 3 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆105Updated this week
- ☆187Updated last year
- Customized matrix multiplication kernels☆53Updated 2 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆103Updated 2 years ago
- ☆202Updated 4 months ago
- ☆248Updated this week
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆176Updated last month
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago
- Low Precision Arithmetic Simulation in PyTorch☆258Updated 3 months ago
- Implementation for the paper "Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization"☆73Updated 4 years ago
- ☆53Updated 5 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆315Updated last year
- ☆142Updated last year
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 8 months ago
- ☆81Updated 4 years ago
- Programmable Neural Network Compression☆146Updated 2 years ago
- ☆32Updated last year
- A library for unit scaling in PyTorch☆94Updated 2 weeks ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆45Updated 3 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆328Updated this week
- Identify a binary weight or binary weight and activation subnetwork within a randomly initialized network by only pruning and binarizing …☆48Updated 2 years ago
- A research library for pytorch-based neural network pruning, compression, and more.☆161Updated last year
- Implementation of "NITI: Training Integer Neural Networks Using Integer-only Arithmetic" on arxiv☆75Updated 2 years ago
- Sparsity support for PyTorch☆31Updated 11 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆127Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 3 years ago