Sharath-girish / LilNetX
Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
☆44Updated 2 years ago
Related projects: ⓘ
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated last year
- ☆30Updated 3 months ago
- ☆48Updated 11 months ago
- Implementation of LogAvgExp for Pytorch☆32Updated 2 years ago
- ☆48Updated 3 months ago
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆29Updated last year
- ☆25Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated last year
- ImageNet-12k subset of ImageNet-21k (fall11)☆19Updated last year
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 2 years ago
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 2 years ago
- Repo for the paper "Extrapolating from a Single Image to a Thousand Classes using Distillation"☆37Updated 2 months ago
- Transformers w/o Attention, based fully on MLPs☆85Updated 5 months ago
- An open source implementation of CLIP.☆32Updated last year
- FID computation in Jax/Flax.☆23Updated 2 months ago
- A simple minimal implementation of Reversible Vision Transformers☆114Updated 6 months ago
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆26Updated 5 months ago
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆38Updated last year
- Generate bird's-eye views of conference proceedings.☆22Updated last month
- DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos☆60Updated last year
- Simple CIFAR-10 classification with ConvMixer☆40Updated 2 years ago
- PyTorch implementation of the paper The Lottery Ticket Hypothesis for Object Recognition☆21Updated 3 years ago
- PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].☆17Updated 2 years ago
- ☆44Updated last year
- Code for ICLR 2023 Paper, "Stable Target Field for Reduced Variance Score Estimation in Diffusion Models”☆66Updated last year
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated last year
- ☆21Updated last year
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated last year