This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer Models by Reordering their Sublayers.
☆58Jan 1, 2021Updated 5 years ago
Alternatives and similar repositories for sandwich_transformer
Users that are interested in sandwich_transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for the paper "Latent Relation Language Models" at AAAI-20.☆41Sep 22, 2025Updated last year
- ☆12Nov 11, 2019Updated 6 years ago
- ☆25Jan 30, 2020Updated 6 years ago
- Code for NIPS 2018 paper 'Frequency-Agnostic Word Representation'☆114May 2, 2019Updated 7 years ago
- Code and Data for ACL 2020 paper "Few-Shot NLG with Pre-Trained Language Model"☆188May 23, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Ranking Policy Gradient☆23Nov 27, 2019Updated 6 years ago
- N/A☆19Aug 15, 2022Updated 4 years ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries☆19Nov 29, 2021Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Jul 26, 2021Updated 5 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Question Answering with Interactive Text (QAit), code for EMNLP 2019 paper "Interactive Language Learning by Question Answering"☆44Sep 3, 2019Updated 7 years ago
- NeurIPS 2019 Paper Implementation☆12Nov 22, 2022Updated 3 years ago
- Code on IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems (WWW 2020)☆11Apr 18, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- PyTorch code for meta seq2seq learning☆44Jan 14, 2020Updated 6 years ago
- Understanding the Difficulty of Training Transformers☆332May 31, 2022Updated 4 years ago
- INSET: Sentence Infilling with Inter-sentential Transformer☆30Nov 21, 2020Updated 5 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Nov 22, 2022Updated 3 years ago
- neuronal message passing☆20Oct 30, 2018Updated 7 years ago
- Transformer training code for sequential tasks☆610Sep 14, 2021Updated 5 years ago
- Code for SIGDial 2019 Best Paper: Structured Fusion Networks for Dialog https://arxiv.org/abs/1907.10016☆30Aug 19, 2019Updated 7 years ago
- Pytorch implementation of "Hallucinating Agnostic Images to Generalize Across Domains"☆11Jul 10, 2019Updated 7 years ago
- This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"☆28Jun 22, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The source code of our ACL2019 paper "Incremental Transformer with Deliberation Decoder for Document Grounded Conversations "☆86Aug 30, 2019Updated 7 years ago
- ☆12Mar 20, 2020Updated 6 years ago
- Code for EMNLP 2020 paper CoDIR☆41Oct 4, 2022Updated 4 years ago
- Paranoid Transformer for NaNoGenMo☆19Nov 1, 2020Updated 5 years ago
- Implementation for paper " Unsupervised Domain Adaptation on Reading Comprehension "☆30May 21, 2020Updated 6 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆34Oct 30, 2020Updated 5 years ago
- codes and pre-trained models of paper "Segatron: Segment-aware Transformer for Language Modeling and Understanding"☆18Oct 25, 2022Updated 3 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Nov 10, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)☆14Apr 16, 2019Updated 7 years ago
- Combining encoder-based language models☆11Nov 11, 2021Updated 4 years ago
- ☆11May 9, 2022Updated 4 years ago
- Code for the paper "multi-hop paragraph retrieval for open-domain question answering"☆35Jun 21, 2022Updated 4 years ago
- ☆34Nov 30, 2018Updated 7 years ago
- Neural Text Generation with Unlikelihood Training☆311Aug 31, 2021Updated 5 years ago
- Tools to make git easier to use and to avoid the learning curve☆21Apr 3, 2019Updated 7 years ago