ChristophReich1996 / SmeLU

PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations" [arXiv 2022].
22Updated 2 years ago

Alternatives and similar repositories for SmeLU:

Users that are interested in SmeLU are comparing it to the libraries listed below