Alternatives and similar repositories for ActivationFunctions

Users that are interested in ActivationFunctions are comparing it to the libraries listed below

• reddragon / efficient-dl-survey-paper
  Efficient Deep Learning Survey Paper
  ☆33Updated 2 years ago
• ChristophReich1996 / SmeLU
  PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…
  ☆22Updated 3 years ago
• sayakpaul / MLP-Mixer-CIFAR10
  Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.
  ☆57Updated 3 years ago
• Yu-Group / adaptive-wavelets
  Adaptive, interpretable wavelets across domains (NeurIPS 2021)
  ☆81Updated 3 years ago
• stanislavfort / adversaries_to_convnext
  Adversarial examples to the new ConvNeXt architecture
  ☆20Updated 3 years ago
• Gladys-Zhao / mRNN-mLSTM
  Code for ICML 2020 paper: Do RNN and LSTM have Long Memory?
  ☆17Updated 4 years ago
• isaaccorley / mlp-mixer-pytorch
  PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)
  ☆31Updated 4 years ago
• FrancescoSaverioZuppichini / RepVgg
  Implementing RepVGG in PyTorch
  ☆20Updated 3 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆28Updated 4 years ago
• elliotwaite / pytorch-hooks-tutorial
  Examples of using PyTorch hooks, as covered in my YouTube tutorial video.
  ☆37Updated last year
• minhtannguyen / transformer-mgk
  This is the public github for our paper "Transformer with a Mixture of Gaussian Keys"
  ☆28Updated 3 years ago
• vra / flopth
  A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.
  ☆131Updated 9 months ago
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆54Updated 4 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆23Updated 3 years ago
• The-AI-Summer / RNN_tutorial
  Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch
  ☆28Updated 5 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆63Updated 3 years ago
• pranavphoenix / CXV
  Convolutional Xformers for Vision
  ☆26Updated 3 years ago
• dlmacedo / distinction-maximization-loss
  A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…
  ☆44Updated 2 years ago
• keivanalizadeh / ButterflyTransform
  ☆41Updated 4 years ago
• ChristophReich1996 / HyperMixer
  PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].
  ☆17Updated 3 years ago
• hsndbk4 / GDWS
  Code for the paper titled "Generalized Depthwise-Separable Convolutions for Adversarially Robust and Efficient Neural Networks" (NeurIPS…
  ☆11Updated 3 years ago
• nick11roberts / XD
  ☆12Updated 3 years ago
• abhuse / cyclic-cosine-decay
  Pytorch cyclic cosine decay learning rate scheduler
  ☆49Updated 4 years ago
• tk-rusch / coRNN
  Official code for Coupled Oscillatory RNN (ICLR 2021, Oral)
  ☆49Updated 4 years ago
• haofanwang / awesome-mlp-papers
  Recent Advances in MLP-based Models (MLP is all you need!)
  ☆116Updated 2 years ago
• dwromero / wavelet_networks
  Code repository of the paper "Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Series, TMLR" https://arxiv.org/abs…
  ☆83Updated last year
• dlmacedo / entropic-out-of-distribution-detection
  A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Pe…
  ☆79Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 2 years ago
• lucidrains / deep-linear-network
  A simple implementation of a deep linear Pytorch module
  ☆21Updated 4 years ago