Sharath-girish / LilNetX
Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
☆46Updated 2 years ago
Alternatives and similar repositories for LilNetX:
Users that are interested in LilNetX are comparing it to the libraries listed below
- An open source implementation of CLIP.☆32Updated 2 years ago
- ☆31Updated 7 months ago
- ☆49Updated last year
- ☆25Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆70Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated 2 years ago
- Generate bird's-eye views of conference proceedings.☆23Updated last month
- PyTorch implementation of the paper The Lottery Ticket Hypothesis for Object Recognition☆21Updated 3 years ago
- Implementation of LogAvgExp for Pytorch☆32Updated 2 years ago
- Official implementation for Wavelet Feature Maps Compression for Image-to-Image CNNs, NeurIPS 2022.☆33Updated 2 years ago
- Official code for the paper "Image generation with shortest path diffusion" accepted at ICML 2023.☆22Updated last year
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆35Updated 3 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆19Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Cyclic Differentiable Architecture Search☆35Updated 2 years ago
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆26Updated 9 months ago
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆30Updated last year
- ☆51Updated 7 months ago
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated last year
- Simple notebooks to learn diffusion models on toy datasets☆17Updated last year
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆78Updated last year
- [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…☆52Updated last year
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆15Updated 3 years ago
- A simple minimal implementation of Reversible Vision Transformers☆120Updated 10 months ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Implementation of Kronecker Attention in Pytorch☆18Updated 4 years ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Updated last year
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 2 years ago
- Official repository for MaGNET, ICLR 2022☆24Updated 2 years ago
- Implementation of Spectral Leakage and Rethinking the Kernel Size in CNNs in Pytorch☆14Updated 3 years ago