ChristophReich1996 / SmeLU
PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
☆22Updated 2 years ago
Alternatives and similar repositories for SmeLU:
Users that are interested in SmeLU are comparing it to the libraries listed below
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆29Updated 2 years ago
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 3 years ago
- A simple implementation of a deep linear Pytorch module☆19Updated 4 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆30Updated 3 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆37Updated 2 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- Quickest way to share everything about your research within a single app☆17Updated last year
- Active and Sample-Efficient Model Evaluation☆24Updated 3 years ago
- Implementation of Metaformer, but in an autoregressive manner☆23Updated 2 years ago
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- trying to obtain uncertainties from training accuracies using timm☆9Updated 2 years ago
- ☆48Updated 2 years ago
- Github code for the paper Maximum Class Separation as Inductive Bias in One Matrix. Arxiv link: https://arxiv.org/abs/2206.08704☆28Updated last year
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆15Updated 3 years ago
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆25Updated 3 years ago
- C-Mixup for NeurIPS 2022☆68Updated last year
- ☆35Updated last year
- ☆34Updated 2 years ago
- ☆33Updated 2 years ago
- ☆8Updated last year
- Examples of using PyTorch hooks, as covered in my YouTube tutorial video.☆33Updated last year
- ☆18Updated 9 months ago
- ModelSoups for Tensorflow2 and Torch☆48Updated 2 years ago
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated 2 years ago
- ☆72Updated 2 years ago
- Repository for ICLR'23 Long-tailed Learning Requires Feature Learning☆10Updated last year
- Self Supervised Learning for Time Series Using Similarity Distillation☆10Updated 2 years ago
- Benchmark time series data sets for PyTorch☆34Updated last year