JosselinSomervilleRoberts / BERT-Multitask-learning
Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations
☆18Updated last year
Alternatives and similar repositories for BERT-Multitask-learning:
Users that are interested in BERT-Multitask-learning are comparing it to the libraries listed below
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆94Updated 2 years ago
- Minimalist BERT implementation assignment for CS11-711☆81Updated 2 years ago
- PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.☆61Updated 2 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆80Updated 2 years ago
- domain adaptation in NLP☆52Updated 3 years ago
- Official Code and Data repository of our ACL 2021 paper X-FACT: A New Benchmark Dataset for Multilingual Fact Checking.☆24Updated 4 months ago
- This is the official implementation of the paper: "Contrastive Learning of Sentence Embeddings from Scratch"☆38Updated last year
- The codebase for the paper: A Closer Look at How Fine-tuning Changes BERT☆22Updated last year
- ☆44Updated 2 years ago
- Leveraging ChatGPT for Text Data Augmentation☆34Updated 5 months ago
- On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification☆30Updated 2 years ago
- ☆10Updated 2 years ago
- Code for EMNLP 2021 paper: "Is Everything in Order? A Simple Way to Order Sentences"☆41Updated last year
- Hierarchical Attention Transformers (HAT)☆48Updated last year
- Fine-tuning LLM with LoRA (Low-Rank Adaptation) from scratch (Oct 2023)☆16Updated last year
- ☆41Updated 3 years ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- This repository lists papers, codes, and datasets in Biomedical Text Summarisation based on PLM☆23Updated 2 years ago
- codes and pre-trained models of paper "Segatron: Segment-aware Transformer for Language Modeling and Understanding"☆18Updated 2 years ago
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆40Updated 3 months ago
- Our EMNLP 2022 paper on MCQA☆23Updated 2 years ago
- ☆12Updated last year
- Emotion-Aware Dialogue Response Generation by Multi-Task Learning☆13Updated 3 years ago
- ☆55Updated 2 years ago
- Code and Resources for the paper, "Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries"☆14Updated 10 months ago
- ConTextual Mask Auto-Encoder for Dense Passage Retrieval☆35Updated 3 months ago
- Uncertainty-Aware Reliable Text Classification (KDD 2021)☆16Updated 2 years ago
- This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.☆47Updated 2 years ago
- GRUEN for Evaluating Linguistic Quality of Generated Text (EMNLP 2020 Findings)☆28Updated 2 years ago
- ☆61Updated last year