zeke-xie / stable-weight-decay-regularization
[NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.
☆57Updated 7 months ago
Related projects: ⓘ
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆76Updated 8 months ago
- [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neur…☆34Updated 3 years ago
- [ICDM 2023] Momentum is All You Need for Data-Driven Adaptive Optimization☆22Updated 5 months ago
- Denoising Masked Autoencoders Help Robust Classification.☆57Updated last year
- ☆58Updated last year
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆21Updated 6 months ago
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆138Updated last year
- Repository containing code for blockwise SSL training☆27Updated last year
- Code for "Implicit Normalizing Flows" (ICLR 2021 spotlight)☆34Updated 3 years ago
- Official code for the paper "Image generation with shortest path diffusion" accepted at ICML 2023.☆20Updated last year
- ResMLP: Feedforward networks for image classification with data-efficient training☆38Updated 3 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆76Updated 2 years ago
- [ICLR 2022]: Fast AdvProp☆35Updated 2 years ago
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 2 years ago
- [NeurIPS'22] What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective☆35Updated last year
- ☆20Updated last year
- [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation☆40Updated last year
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆24Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated last year
- A torch-based implementation of K-Means and K-Means++☆17Updated 3 years ago
- ☆41Updated 3 years ago
- Official implementation for Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models (ICML 2022), and a re…☆102Updated 2 years ago
- ☆26Updated 2 years ago
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆52Updated 2 years ago
- ☆44Updated 2 years ago
- PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"☆47Updated last year
- Codes for CyGen, the novel generative modeling framework proposed in "On the Generative Utility of Cyclic Conditionals" (NeurIPS-21)☆45Updated 2 years ago
- Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.☆33Updated last year
- Code for ICLR 2023 Paper, "Stable Target Field for Reduced Variance Score Estimation in Diffusion Models”☆66Updated last year