shivram1987 / ActivationFunctions
☆48Updated 2 years ago
Alternatives and similar repositories for ActivationFunctions:
Users that are interested in ActivationFunctions are comparing it to the libraries listed below
- Efficient Deep Learning Survey Paper☆33Updated 2 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆30Updated 3 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆54Updated 2 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 2 years ago
- Examples of using PyTorch hooks, as covered in my YouTube tutorial video.☆33Updated last year
- several types of attention modules written in PyTorch for learning purposes☆45Updated 4 months ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆22Updated 3 years ago
- ☆41Updated 3 years ago
- Code for the paper titled "Generalized Depthwise-Separable Convolutions for Adversarially Robust and Efficient Neural Networks" (NeurIPS…☆11Updated 3 years ago
- Open Sourced ML Research Paper Implementations in Tensorflow☆19Updated 3 years ago
- MLPNAS code for Paperspace series on Neural Architecture Search☆22Updated last year
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- Large dataset storage format for Pytorch☆45Updated 3 years ago
- Code for the anonymous submission "Cockpit: A Practical Debugging Tool for Training Deep Neural Networks"☆31Updated 4 years ago
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆25Updated 3 years ago
- Unofficial pytorch implementation of Piecewise Linear Unit dynamic activation function☆16Updated 2 years ago
- Cyclemoid implementation for PyTorch☆87Updated 2 years ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆32Updated last year
- Vision Xformers☆21Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆125Updated 2 months ago
- ☆36Updated 3 years ago
- In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…☆22Updated 3 years ago
- Pruning applied to Facial Recognition.☆15Updated 5 years ago
- Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.☆71Updated 2 years ago
- Public repository for "DCT-Former: Efficient Self-Attention withDiscrete Cosine Transform"☆18Updated last year
- Library - Vanilla, ViT, DeiT, BERT, GPT☆64Updated 3 years ago
- Adaptive, interpretable wavelets across domains (NeurIPS 2021)☆74Updated 3 years ago
- Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification☆46Updated 2 years ago
- ☆72Updated 2 years ago
- A simple implementation of [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://arxiv.org/abs/2312.00752)☆21Updated last year