ChristophReich1996 / SmeLULinks
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
☆22Updated 3 years ago
Alternatives and similar repositories for SmeLU
Users that are interested in SmeLU are comparing it to the libraries listed below
Sorting:
- ☆110Updated 3 years ago
- Recycling diverse models☆46Updated 2 years ago
- ☆75Updated 3 years ago
- Layerwise Batch Entropy Regularization☆24Updated 3 years ago
- ☆12Updated 3 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆63Updated 3 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆37Updated 2 years ago
- ☆37Updated 3 years ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆44Updated 3 years ago
- A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Pe…☆79Updated 3 years ago
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆79Updated 2 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆58Updated 2 years ago
- ☆15Updated 3 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 3 years ago
- ☆58Updated 2 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31Updated 4 years ago
- A benchmark of data-centric tasks from across the machine learning lifecycle.☆72Updated 3 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 5 years ago
- Reproducible code for Augmentation paper☆17Updated 6 years ago
- Axial Positional Embedding for Pytorch☆84Updated 9 months ago
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 4 years ago
- Domain Adaptation☆23Updated 4 years ago
- Efficient Deep Learning Survey Paper☆34Updated 2 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Updated 5 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆27Updated 3 years ago
- ☆37Updated 2 years ago
- ☆54Updated 3 years ago
- Parameterizing Mixing Links in Sparse Factors Works Better than Dot-Product Self-Attention (CVPR 2022)☆20Updated 2 years ago