ChristophReich1996 / SmeLULinks
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
☆22Updated 3 years ago
Alternatives and similar repositories for SmeLU
Users that are interested in SmeLU are comparing it to the libraries listed below
Sorting:
- Recycling diverse models☆45Updated 2 years ago
- ☆108Updated 2 years ago
- ☆75Updated 2 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.☆72Updated 2 years ago
- ☆15Updated 3 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆63Updated 3 years ago
- ModelSoups for Tensorflow2 and Torch☆50Updated 3 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆57Updated 3 years ago
- ☆53Updated 3 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆36Updated 2 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31Updated 4 years ago
- A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Pe…☆79Updated 2 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- ☆37Updated last year
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 4 years ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆44Updated 2 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 3 years ago
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆78Updated last year
- ☆57Updated 3 years ago
- ☆18Updated last year
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated 2 years ago
- Making Heads or Tails Towards Semantically Consistent Visual Counterfactuals☆30Updated 3 years ago
- Domain Adaptation☆23Updated 3 years ago
- ☆58Updated 2 years ago
- ☆23Updated 2 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆59Updated 2 years ago
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Updated 2 years ago
- Layerwise Batch Entropy Regularization☆23Updated 3 years ago