LIJUNYI95 / SuperAdam
Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
☆17Updated 3 years ago
Alternatives and similar repositories for SuperAdam:
Users that are interested in SuperAdam are comparing it to the libraries listed below
- Implementation for NATv2.☆23Updated 4 years ago
- ☆24Updated 3 years ago
- The project is about predicting sets (of classes) from images.☆22Updated 3 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- Implementation of the LOSSGRAD optimization algorithm☆15Updated 6 years ago
- Implementation of Kronecker Attention in Pytorch☆18Updated 4 years ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Updated 3 years ago
- Self-Distillation with weighted ground-truth targets; ResNet and Kernel Ridge Regression☆17Updated 3 years ago
- Multi-Target Embodied Question Answering☆11Updated 6 years ago
- ☆34Updated 6 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆15Updated 3 years ago
- ☆23Updated 4 years ago
- Directed masked autoencoders☆14Updated 2 years ago
- Official Pytorch implementation of the paper: "Locally Shifted Attention With Early Global Integration"☆15Updated 3 years ago
- LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)☆18Updated last year
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated last year
- This dataset contains about 110k images annotated with the depth and occlusion relationships between arbitrary objects. It enables resear…☆16Updated 3 years ago
- Automatic Query Image Disambiguation (AID)☆11Updated 7 years ago
- ☆13Updated 7 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 7 years ago
- [ICLR2024] (EvALign-ICL Benchmark) Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context …☆21Updated last year
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆13Updated 5 years ago
- ☆13Updated 5 years ago
- Lifelong Variational Autoencoder☆14Updated 7 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- An adaptive training algorithm for residual network☆15Updated 4 years ago
- A PyTorch Dataset that caches samples in shared memory, accessible globally to all processes☆21Updated 2 years ago
- Optimization and Generalization Analysis of Transduction through Gradient Boosting and Application to Multi-scale Graph Neural Networks☆13Updated 4 years ago
- A pytorch implementation of Information Bottleneck GAN☆28Updated 6 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Updated 4 years ago