ChristophReich1996 / SmeLU
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
☆22Updated 2 years ago
Alternatives and similar repositories for SmeLU:
Users that are interested in SmeLU are comparing it to the libraries listed below
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- ☆73Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆29Updated 2 years ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Pe…☆75Updated 2 years ago
- ModelSoups for Tensorflow2 and Torch☆48Updated 2 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated 4 years ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated 2 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆28Updated 2 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆37Updated 2 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆30Updated 3 years ago
- A simple implementation of a deep linear Pytorch module☆19Updated 4 years ago
- ☆33Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Github code for the paper Maximum Class Separation as Inductive Bias in One Matrix. Arxiv link: https://arxiv.org/abs/2206.08704☆29Updated last year
- Domain Adaptation☆23Updated 3 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- ☆35Updated 2 years ago
- ☆49Updated 2 years ago
- Deep Critical Learning. Implementation of ProSelfLC, IMAE, DM, etc.☆31Updated 2 years ago
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 4 years ago
- A project to train your model from scratch or fine-tune a pretrained model using the losses provided in this library to improve out-of-di…☆17Updated 2 years ago
- Advances in Neural Information Processing Systems (NeurIPS 2021)☆22Updated 2 years ago
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 3 years ago
- Sharpness-Aware Minimization for Efficiently Improving Generalization☆41Updated 3 years ago
- ☆35Updated last year
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆25Updated 3 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- ☆108Updated 2 years ago