Trains Transformer model variants. Data isn't shuffled between batches.
☆145Oct 5, 2022Updated 4 years ago
Alternatives and similar repositories for transformer-sequential
Users that are interested in transformer-sequential are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sequence modeling with Mega.☆300Jan 28, 2023Updated 3 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆228Apr 18, 2022Updated 4 years ago
- Implementation of Feedback Transformer in Pytorch☆108Mar 2, 2021Updated 5 years ago
- lanmt ebm☆12Jun 19, 2020Updated 6 years ago
- ☆33Apr 12, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆30Jan 17, 2022Updated 4 years ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆34Oct 30, 2020Updated 6 years ago
- Source code for "N-ary Constituent Tree Parsing with Recursive Semi-Markov Model" published at ACL 2021☆10May 27, 2021Updated 5 years ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆176Jun 6, 2021Updated 5 years ago
- Transformer training code for sequential tasks☆610Sep 14, 2021Updated 5 years ago
- GPT, but made only out of MLPs☆89May 25, 2021Updated 5 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆358Feb 22, 2022Updated 4 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆31Dec 5, 2022Updated 3 years ago
- Cascaded Text Generation with Markov Transformers☆130Mar 20, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fully featured implementation of Routing Transformer☆300Nov 6, 2021Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Jul 26, 2021Updated 5 years ago
- [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling☆73Nov 23, 2022Updated 3 years ago
- Neural Text Generation with Unlikelihood Training☆311Aug 31, 2021Updated 5 years ago
- ☆23Dec 1, 2021Updated 4 years ago
- Understanding the Difficulty of Training Transformers☆332May 31, 2022Updated 4 years ago
- 日本語CLIPモデル☆13Sep 15, 2025Updated last year
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆125Nov 13, 2020Updated 5 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆432Aug 17, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15May 14, 2019Updated 7 years ago
- My implementation of DeepMind's Perceiver☆65Apr 23, 2021Updated 5 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- ☆332Jun 7, 2021Updated 5 years ago
- ☆48Apr 12, 2019Updated 7 years ago
- SMiLER - Samsung MultiLingual Entity and Relation Extraction dataset☆18Feb 11, 2021Updated 5 years ago
- brat rapid annotation tool (brat) - for all your textual annotation needs☆10Feb 3, 2018Updated 8 years ago
- Pytorch implementation of Compressive Transformers, from Deepmind☆165Oct 4, 2021Updated 5 years ago
- Implementation of Multistream Transformers in Pytorch☆54Jul 31, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Staged Training for Transformer Language Models☆33Mar 31, 2022Updated 4 years ago
- ☆85Dec 1, 2023Updated 2 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆39Feb 14, 2020Updated 6 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆61Apr 19, 2022Updated 4 years ago
- Implementation of Fast Transformer in Pytorch☆176Aug 26, 2021Updated 5 years ago
- ☆21Mar 14, 2021Updated 5 years ago