JosselinSomervilleRoberts / BERT-Multitask-learning
Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations
☆19Updated last year
Alternatives and similar repositories for BERT-Multitask-learning:
Users that are interested in BERT-Multitask-learning are comparing it to the libraries listed below
- A simple recipe for training and inferencing Transformer architecture for Multi-Task Learning on custom datasets. You can find two approa…☆95Updated 2 years ago
- A PyTorch implementation of "Graph Convolutional Networks for Text Classification." (AAAI 2019)☆126Updated 4 years ago
- WideMLP for Text Classification☆29Updated 8 months ago
- domain adaptation in NLP☆53Updated 3 years ago
- This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…☆70Updated last year
- Fine-tuning LLM with LoRA (Low-Rank Adaptation) from scratch (Oct 2023)☆19Updated last year
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆81Updated 2 years ago
- Minimalist BERT implementation assignment for CS11-711☆81Updated 2 years ago
- ☆20Updated 3 years ago
- ☆16Updated 3 years ago
- [WWW 2022] Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations☆87Updated 3 years ago
- ☆44Updated 2 years ago
- An assignment for building an NLP system from scratch.☆25Updated last year
- Benchmarking various Deep Learning models such as BERT, ALBERT, BiLSTMs on the task of sentence entailment using two datasets - MultiNLI …☆28Updated 4 years ago
- ☆26Updated 10 months ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆62Updated 2 years ago
- ☆61Updated 2 years ago
- A extension of Transformers library to include T5ForSequenceClassification class.☆38Updated 2 years ago
- This repository is the team ETS-Lab's solution towards KDD Cup 2022.☆34Updated 10 months ago
- NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings☆55Updated 10 months ago
- Feedback Prize - English Language Learning: 1st place solution code☆56Updated 2 years ago
- PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.☆62Updated 2 years ago
- The source code of paper "PAIR-LEVEL SUPERVISED CONTRASTIVE LEARNING FOR NATURAL LANGUAGE INFERENCE" at ICASSP 2022.☆48Updated last year
- This repo contains the dataset and description for Ruddit and its variants.☆34Updated 3 years ago
- ☆18Updated 3 years ago
- This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).☆24Updated 2 years ago
- Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from hu…☆43Updated 3 years ago
- Uncertainty-Aware Reliable Text Classification (KDD 2021)☆17Updated 2 years ago
- ☆35Updated 3 years ago
- ☆78Updated 2 years ago