lessw2020 / Ranger22
Testing various improvements to Ranger21 for 2022
☆18Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Ranger22
- Implementation of LogAvgExp for Pytorch☆32Updated 2 years ago
- Batch Renormalization in Pytorch☆45Updated last year
- Framework for creating (partially) reversible neural networks with PyTorch☆147Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Implementation of Uformer, Attention-based Unet, in Pytorch☆93Updated 3 years ago
- A fully invertible U-Net for memory efficiency in Pytorch.☆121Updated 2 years ago
- ☆41Updated 3 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆35Updated 3 years ago
- ☆73Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆76Updated 10 months ago
- A convolution-free, transformer-only version of the CycleGAN framework☆32Updated 2 years ago
- Pytorch cyclic cosine decay learning rate scheduler☆48Updated 3 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago
- Hacks for PyTorch☆17Updated last year
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- ☆6Updated 11 months ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 2 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- ImageNet-12k subset of ImageNet-21k (fall11)☆20Updated last year
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks☆27Updated 2 years ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆84Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated last year
- Code of "Deep invariant networks with differentiable augmentation layers"☆18Updated 2 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…☆50Updated 2 years ago
- ☆25Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated 2 years ago
- Simple CIFAR-10 classification with ConvMixer☆41Updated 2 years ago