shivram1987 / ActivationFunctionsLinks
☆50Updated 2 years ago
Alternatives and similar repositories for ActivationFunctions
Users that are interested in ActivationFunctions are comparing it to the libraries listed below
Sorting:
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆56Updated 2 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 3 years ago
- ☆41Updated 4 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆30Updated 4 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- Implementing RepVGG in PyTorch☆19Updated 2 years ago
- Library - Vanilla, ViT, DeiT, BERT, GPT☆66Updated 3 years ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆23Updated 3 years ago
- Drop-in convolutional Kolmogorov-Arnold Network replacement of Conv2d☆18Updated last year
- MLPNAS code for Paperspace series on Neural Architecture Search☆22Updated 2 years ago
- Unofficial Implementation of MLP-Mixer in TensorFlow☆27Updated 4 years ago
- Adaptive, interpretable wavelets across domains (NeurIPS 2021)☆77Updated 3 years ago
- ☆74Updated 2 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆61Updated 3 years ago
- [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…☆30Updated 3 years ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆32Updated 3 years ago
- Benchmarking PyTorch 2.0 different models☆21Updated 2 years ago
- sharpDARTS: Faster and More Accurate Differentiable Architecture Search☆16Updated 4 years ago
- several types of attention modules written in PyTorch for learning purposes☆53Updated 8 months ago
- In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…☆24Updated 4 years ago
- Vision Xformers☆21Updated 2 years ago
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆27Updated 4 years ago
- Examples of using PyTorch hooks, as covered in my YouTube tutorial video.☆33Updated last year
- Includes additional materials for the following keras.io blog post.☆12Updated 3 years ago
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆129Updated 6 months ago
- Code for the paper titled "Generalized Depthwise-Separable Convolutions for Adversarially Robust and Efficient Neural Networks" (NeurIPS…☆11Updated 3 years ago
- Implementation of transformers based architecture in PyTorch.☆54Updated 4 years ago
- Code repository of the paper "Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Series, TMLR" https://arxiv.org/abs…☆82Updated last year
- Unofficial pytorch implementation of Piecewise Linear Unit dynamic activation function☆17Updated 2 years ago