JosselinSomervilleRoberts / BERT-Multitask-learningLinks
Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations
☆19Updated last year
Alternatives and similar repositories for BERT-Multitask-learning
Users that are interested in BERT-Multitask-learning are comparing it to the libraries listed below
Sorting:
- A extension of Transformers library to include T5ForSequenceClassification class.☆38Updated 2 years ago
- ☆61Updated 2 years ago
- domain adaptation in NLP☆53Updated 3 years ago
- Minimalist BERT implementation assignment for CS11-711☆83Updated 2 years ago
- Continue Pretraining T5 on custom dataset based on available pretrained model checkpoints☆38Updated 4 years ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆38Updated last year
- EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation☆41Updated 2 years ago
- [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Prompting☆27Updated 2 years ago
- This is the code for the ICLR 2023 paper "Leveraging Large Language Models for Multiple Choice Question Answering."☆40Updated 2 years ago
- Fine-tuning LLM with LoRA (Low-Rank Adaptation) from scratch (Oct 2023)☆21Updated last year
- Data Augmentation for Intent Classification with Off-the-Shelf Large Language Models is a ServiceNow Research project☆29Updated last year
- ☆23Updated 10 months ago
- ACL'23: Unified Demonstration Retriever for In-Context Learning☆37Updated last year
- ☆35Updated 3 years ago
- Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embedd…☆59Updated 5 months ago
- ☆49Updated 3 years ago
- ☆20Updated 3 years ago
- [COLING'22] Code for our paper: "COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization"☆22Updated 2 years ago
- This repository lists papers, codes, and datasets in Biomedical Text Summarisation based on PLM☆23Updated 2 years ago
- ☆35Updated 2 years ago
- ☆17Updated last year
- Document Classification on COVID-19 Literature using the LitCovid collection and the Hedwig library.☆16Updated 7 months ago
- Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers☆49Updated 2 years ago
- ☆75Updated 8 months ago
- Mutual Information Predicts Hallucinations in Abstractive Summarization☆12Updated 2 years ago
- ☆26Updated 2 years ago
- CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models☆31Updated last year
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 2 years ago
- A curated list of research papers and resources on Cultural LLM.☆44Updated 8 months ago
- Two approaches for robust TableQA: 1) ITR is a general-purpose retrieval-based approach for handling long tables in TableQA transformer m…☆38Updated last year