skolai / fewbit
Compression schema for gradients of activations in backward pass
☆44Updated last year
Alternatives and similar repositories for fewbit:
Users that are interested in fewbit are comparing it to the libraries listed below
- Learning to Initialize Neural Networks for Stable and Efficient Training☆138Updated 2 years ago
- ☆71Updated 6 months ago
- FLOPs and other statistics COunter for Pytorch neural networks☆23Updated 3 years ago
- ☆20Updated 8 months ago
- Code for MSID, a Multi-Scale Intrinsic Distance for comparing generative models, studying neural networks, and more!☆51Updated 5 years ago
- MUSCO: MUlti-Stage COmpression of neural networks☆71Updated 4 years ago
- Code for the paper "Secure Distributed Training at Scale" (ICML 2022)☆15Updated last month
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- ☆60Updated 4 years ago
- ☆18Updated 3 months ago
- Code for the paper "PALBERT: Teaching ALBERT to Ponder", NeurIPS 2022 Spotlight☆37Updated last year
- "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…☆54Updated 4 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Deep Generative Models course, 2021☆22Updated 3 years ago
- ☆36Updated last year
- The official implementation of the ChordMixer architecture.☆61Updated last year
- Lightweight knowledge distillation pipeline☆28Updated 3 years ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)☆116Updated 3 years ago
- Spartan is an algorithm for training sparse neural network models. This repository accompanies the paper "Spartan Differentiable Sparsity…☆24Updated 2 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆60Updated 2 years ago
- Dynamic Neural Architecture Search Toolkit☆29Updated 3 months ago
- Blog post☆17Updated last year
- Very simple and short implementation of gradient boosting in 18 lines of code☆9Updated 4 years ago
- ☆15Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- NLA 2018 Skoltech course☆53Updated 6 years ago
- Customized matrix multiplication kernels☆53Updated 3 years ago
- A library for unit scaling in PyTorch☆124Updated 3 months ago