Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
☆71May 28, 2020Updated 6 years ago
Alternatives and similar repositories for Synthesizer-Rethinking-Self-Attention-Transformer-Models
Users that are interested in Synthesizer-Rethinking-Self-Attention-Transformer-Models are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bag of MLP☆20May 31, 2021Updated 5 years ago
- Implementing Pyramid Scene Parsing Network (PSPNet) paper using Pytorch☆16Sep 1, 2020Updated 6 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 4 years ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 4 years ago
- Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms☆20Nov 29, 2021Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- KANs and MLPs☆12Jun 7, 2024Updated 2 years ago
- Multimodal classification solution for the SIGIR eCOM using Co-attention and transformer language models☆19Aug 17, 2020Updated 6 years ago
- tensorflow implementation of Exploring Randomly Wired Neural Networks for Image Recognition☆32Dec 16, 2019Updated 6 years ago
- [ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"☆32Dec 30, 2021Updated 4 years ago
- ☆11Oct 16, 2020Updated 5 years ago
- 🤗An unofficial PyTorch implementation of ConvBert based on huggingface/transformers.☆17Oct 6, 2022Updated 3 years ago
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆86Mar 7, 2023Updated 3 years ago
- Implementing MixNet: Mixed Depthwise Convolutional Kernels using Pytorch☆62Jun 11, 2020Updated 6 years ago
- Code for our SIGIR 2021 short paper "Lighter and Better: Low-Rank Decomposed Self-Attention Networks for Next-Item Recommendation."☆15May 5, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of the paper "Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting", https://arxi…☆19Jul 20, 2021Updated 5 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 5 years ago
- ☆27Jun 23, 2020Updated 6 years ago
- ☆19Mar 17, 2021Updated 5 years ago
- ☆50Nov 10, 2023Updated 2 years ago
- Implementation for the EMNLP 2021 paper "Interactive Machine Comprehension with Dynamic Knowledge Graphs".☆22Aug 31, 2021Updated 5 years ago
- ☆18Aug 9, 2018Updated 8 years ago
- ☆25May 21, 2018Updated 8 years ago
- The implementation of 'M3Net: Multilevel, Mixed and Multistage Attention Network for Salient Object Detection'.☆12Apr 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆21Aug 2, 2020Updated 6 years ago
- (ICCV 2021) BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search☆143Dec 6, 2021Updated 4 years ago
- Multi-Head Attention, Transformer, Perceiver, Linear Attention.☆12Oct 24, 2023Updated 2 years ago
- Bottleneck Transformers for Visual Recognition☆280Mar 14, 2021Updated 5 years ago
- CP-GAN: Class-Distinct and Class-Mutual Image Generation with GANs☆15Jun 19, 2021Updated 5 years ago
- 사전에서 대화 예문만 추출한 데이터☆16Apr 24, 2023Updated 3 years ago
- Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.☆24Jan 17, 2022Updated 4 years ago
- ☆24Apr 14, 2025Updated last year
- A long version of BART model based on Longformer model☆24Jun 12, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ACL‘20] Highway Transformer: A Gated Transformer.☆33Dec 5, 2021Updated 4 years ago
- The implementation of "Does Multi-Encoder Help? A Case Study on Context-AwareNeural Machine Translation"☆39Aug 26, 2020Updated 6 years ago
- This is the repository for our WSDM 2020 publication: Interpretable Click-through Rate Prediction through Hierarchical Attention☆40Oct 29, 2019Updated 6 years ago
- [KDD'22] Learned Token Pruning for Transformers☆98Feb 27, 2023Updated 3 years ago
- ☆14Jul 27, 2022Updated 4 years ago
- ☆18Aug 11, 2022Updated 4 years ago
- An optimized Transformer based abstractive summarization model with Tensorflow☆17Oct 17, 2022Updated 3 years ago