pashu123 / TransformersLinks
Pytorch Implementation of Transformers Explained with Comments
☆16Updated 5 years ago
Alternatives and similar repositories for Transformers
Users that are interested in Transformers are comparing it to the libraries listed below
Sorting:
- Network Pruning That Matters: A Case Study on Retraining Variants (ICLR 2021)☆17Updated 4 years ago
- A research library for pytorch-based neural network pruning, compression, and more.☆162Updated 3 years ago
- ☆17Updated 5 years ago
- Using ideas from product quantization for state-of-the-art neural network compression.☆145Updated 4 years ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆23Updated 4 years ago
- A collection of metrics to profile a single deep learning model or compare two different deep learning models☆27Updated 2 years ago
- RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network☆15Updated 3 years ago
- A implement of run-length encoding for Pytorch tensor using CUDA☆14Updated 4 years ago
- MONeT framework for reducing memory consumption of DNN training☆174Updated 4 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Updated 3 years ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆224Updated 10 months ago
- Binarize convolutional neural networks using pytorch☆149Updated 3 years ago
- Courbariaux, Matthieu, Yoshua Bengio, and Jean-Pierre David. "Binaryconnect: Training deep neural networks with binary weights during pro…☆12Updated 5 years ago
- Estimate/count FLOPS for a given neural network using pytorch☆305Updated 3 years ago
- Pytorch implementation of our paper accepted by NeurIPS 2020 -- Rotated Binary Neural Network☆83Updated 3 years ago
- Transformers w/o Attention, based fully on MLPs☆97Updated last year
- ☆58Updated 3 years ago
- All about acceleration and compression of Deep Neural Networks☆33Updated 6 years ago
- Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf☆201Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆132Updated last year
- Overview of conditional computution and dynamic CNNs for computer vision, with a focus on reducing computational complexity☆44Updated 3 years ago
- Pytorch ImageNet training codes with various tricks, lr schedulers, distributed training, mixed precision training, DALI dataloader etc.☆18Updated 5 years ago
- PyTorch implementation of MLP-Mixer: An all-MLP Architecture for Vision☆29Updated 4 years ago
- Official implementation of "UNAS: Differentiable Architecture Search Meets Reinforcement Learning", CVPR 2020 Oral☆63Updated 2 years ago
- A Numpy implementation of a Convolutional Neural Network: slow & fast (im2col/col2im).☆58Updated 2 years ago
- Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight…☆64Updated last year
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆73Updated 3 years ago
- My PhD manuscript LaTeX code and the slides for the defense☆11Updated 4 years ago
- Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer☆114Updated 2 years ago
- Pytorch implementation of EENets☆21Updated last year