nlpyang / pytorch-transformers
πΎ A library of state-of-the-art pretrained models for Natural Language Processing (NLP)
β23Updated 5 years ago
Related projects: β
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paperβ131Updated last year
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Selfβ¦β200Updated 2 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch β¦β77Updated last year
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)β128Updated 7 months ago
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approaβ¦β87Updated 2 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networksβ225Updated last year
- [EMNLP 2021] Text AutoAugment: Learning Compositional Augmentation Policy for Text Classificationβ125Updated last year
- This shows how to fine-tune Bert language model and use PyTorch-transformers for text classififcationβ69Updated 4 years ago
- A repo to explore different NLP tasks which can be solved using T5β168Updated 3 years ago
- Awesome Neural Adaptation in Natural Language Processing. A curated list. https://arxiv.org/abs/2006.00632β261Updated 3 years ago
- PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"β94Updated 5 years ago
- [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretrainingβ120Updated last year
- [EMNLP 2021] Improving and Simplifying Pattern Exploiting Trainingβ153Updated 2 years ago
- Long Document Summarization Papersβ132Updated last year
- β342Updated 3 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).β184Updated last year
- A curated list of few-shot learning in NLP. :-)β65Updated 2 years ago
- Code for the paper "True Few-Shot Learning in Language Models" (https://arxiv.org/abs/2105.11447)β142Updated 2 years ago
- PyTorch implementation for Seq2Seq model with attention and Greedy Search / Beam Search for neural machine translationβ57Updated 3 years ago
- A Light and Modular PyTorch NLP Project Templateβ58Updated 4 years ago
- Code from the paper "What do Models Learn from Question Answering Datasets?" (EMNLP 2020)β54Updated 3 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networks in Pytorch/HuggingFaceβ91Updated 2 years ago
- β292Updated last year
- Detect toxic spans in toxic textsβ66Updated last year
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)β324Updated 8 months ago
- X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classificationβ134Updated 3 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinesβ131Updated last year
- A library to conduct ranking experiments with transformers.β161Updated last year
- A BART version of an open-domain QA model in a closed-book setupβ120Updated 4 years ago
- Materials for ACL-2022 tutorial: Knowledge-Augmented Methods for Natural Language Processingβ289Updated 2 years ago