JosselinSomervilleRoberts / BERT-Multitask-learning
Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations
☆15Updated last year
Related projects ⓘ
Alternatives and complementary repositories for BERT-Multitask-learning
- Minimalist BERT implementation assignment for CS11-711☆79Updated 2 years ago
- My solutions for 2019/2021 CS224n Assignments.☆33Updated 3 years ago
- ☆61Updated last year
- Solutions for CS224n (2022)☆56Updated 6 months ago
- ☆78Updated 2 years ago
- Implementation of ICLR 21 paper: Probing BERT in Hyperbolic Spaces☆56Updated 3 years ago
- A simple project training 3 separate NLP tasks simultaneously using Multitask-Learning☆22Updated last year
- Official PyTorch Implementation of SSMix (Findings of ACL 2021)☆61Updated 3 years ago
- ☆18Updated 3 years ago
- ☆150Updated 9 months ago
- Code accompanying EMNLP 2020 paper "Cold-start Active Learning through Self-supervised Language Modeling".☆40Updated 3 years ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆58Updated 2 years ago
- ☆42Updated 2 years ago
- On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification☆30Updated last year
- ☆93Updated 2 years ago
- This repository lists papers, codes, and datasets in Biomedical Text Summarisation based on PLM☆22Updated 2 years ago
- domain adaptation in NLP☆53Updated 3 years ago
- Listing some diffusion papers in NLP domain I have read, text generation is main, table will continue to be updated.☆28Updated 2 weeks ago
- Code for paper 'Data-Efficient FineTuning'☆29Updated last year
- [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning☆92Updated 2 years ago
- ACL 2022(findings): A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings☆18Updated 2 years ago
- Our EMNLP 2022 paper on MCQA☆22Updated last year
- ☆35Updated last year
- Uncertainty-Aware Reliable Text Classification (KDD 2021)☆16Updated 2 years ago
- Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.☆31Updated 3 years ago
- The source code of paper "PAIR-LEVEL SUPERVISED CONTRASTIVE LEARNING FOR NATURAL LANGUAGE INFERENCE" at ICASSP 2022.☆47Updated last year
- ☆19Updated 2 years ago
- This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.☆45Updated 2 years ago
- [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536☆35Updated 2 years ago
- WideMLP for Text Classification☆27Updated 3 months ago