JosselinSomervilleRoberts / BERT-Multitask-learningLinks
Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations
☆19Updated 2 years ago
Alternatives and similar repositories for BERT-Multitask-learning
Users that are interested in BERT-Multitask-learning are comparing it to the libraries listed below
Sorting:
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆96Updated 3 years ago
- This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…☆78Updated last year
- ☆46Updated 3 years ago
- Minimalist BERT implementation assignment for CS11-711☆83Updated 3 years ago
- ☆19Updated 4 years ago
- A extension of Transformers library to include T5ForSequenceClassification class.☆40Updated 2 years ago
- Easy modernBERT fine-tuning and multi-task learning☆61Updated 3 months ago
- Define Transformers, T5 model and RoBERTa Encoder decoder model for product names generation☆48Updated 4 years ago
- A curated list of zero-shot learning in NLP. :-)☆14Updated 3 years ago
- ☆100Updated 3 years ago
- Fine-tuning LLM with LoRA (Low-Rank Adaptation) from scratch (Oct 2023)☆28Updated 2 months ago
- This repo contains the dataset and description for Ruddit and its variants.☆35Updated 3 years ago
- PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.☆62Updated 3 years ago
- ☆42Updated 4 years ago
- [EMNLP 2021] Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification☆131Updated 2 years ago
- Python implementation of an N-gram language model with Laplace smoothing and sentence generation.☆87Updated 7 years ago
- Multi-task modelling extensions for huggingface transformers☆21Updated 2 years ago
- Text classification with Foundation Language Model LLaMA☆114Updated 2 years ago
- Neural information retrieval / Semantic search / Bi-encoders☆174Updated 2 years ago
- Code for our paper "Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation"☆163Updated 3 years ago
- code for the paper "Zero-Shot Text Classification with Self-Training" for EMNLP 2022☆50Updated last month
- Paper List for Contrastive Learning for Natural Language Processing☆565Updated 2 years ago
- ☆187Updated last year
- Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation [NAACL 2024]☆98Updated 2 years ago
- PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models☆110Updated 3 years ago
- In this implementation, using the Flan T5 large language model, we performed the Text Classification task on the IMDB dataset and obtaine…☆23Updated 2 years ago
- Implementation of the first paper on word2vec☆245Updated 3 years ago
- A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning☆155Updated last year
- This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.☆73Updated 2 years ago
- Code for "Finetuning Pretrained Transformers into Variational Autoencoders"☆39Updated 3 years ago