ChristophReich1996 / SmeLU
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
☆22Updated 3 years ago
Alternatives and similar repositories for SmeLU:
Users that are interested in SmeLU are comparing it to the libraries listed below
- ☆73Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆29Updated 2 years ago
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆15Updated 3 years ago
- ☆49Updated 2 years ago
- C-Mixup for NeurIPS 2022☆70Updated last year
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆26Updated 3 years ago
- ☆32Updated last year
- ☆37Updated 3 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated 4 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆28Updated 2 years ago
- ModelSoups for Tensorflow2 and Torch☆48Updated 2 years ago
- Self Supervised Learning for Time Series Using Similarity Distillation☆10Updated 2 years ago
- ☆11Updated 2 years ago
- Official Code for ICML 2023 Data-Efficient Contrastive Self-supervised Learning☆32Updated 11 months ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated 2 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆60Updated 2 years ago
- PyTorch implementation of CorInfoMax☆21Updated 2 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆37Updated 3 years ago
- ☆35Updated last year
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated last year
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- trying to obtain uncertainties from training accuracies using timm☆9Updated 2 years ago
- ☆18Updated 11 months ago
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 4 years ago
- Reproducible code for Augmentation paper☆17Updated 6 years ago