LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_CorpusLinks
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 5 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
Sorting:
- Minimal Interactive Attention Visualization☆140Updated 5 years ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 5 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networks☆228Updated 2 years ago
- Detect toxic spans in toxic texts☆70Updated 2 years ago
- architectures and pre-trained models for long document classification.☆155Updated 4 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆121Updated 4 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆153Updated 5 years ago
- ☆42Updated 5 years ago
- Minimalist implementation of a BERT Sentence Classifier with PyTorch Lightning, Transformers and PyTorch-NLP.☆219Updated 2 years ago
- Summarization Task using Bart and T5 models.☆171Updated 5 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 2 years ago
- Enriching BERT with Knowledge Graph Embedding for Document Classification (PyTorch)☆160Updated 5 years ago
- Using BERT For Classifying Documents with Long Texts, check my latest post: https://armandolivares.tech/☆41Updated 5 years ago
- IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models☆180Updated 4 years ago
- Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in …☆125Updated 5 years ago
- Named Entity Recognition with Pretrained XLM-RoBERTa☆90Updated 4 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- Implementation of paper "Learning to Encode Text as Human-Readable Summaries using GAN"☆66Updated 5 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆230Updated 4 years ago
- A Keras version of Google's BERT model☆34Updated 5 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 6 years ago
- Preprocessing Library for Natural Language Processing☆166Updated 2 years ago
- A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.☆96Updated 4 years ago
- X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification☆138Updated 4 years ago
- reference pytorch code for named entity tagging☆86Updated 11 months ago
- Semantic search using Transformers and others☆110Updated 5 years ago
- A library to conduct ranking experiments with transformers.☆160Updated 2 years ago
- Code and resources for the paper "BERT-QE: Contextualized Query Expansion for Document Re-ranking".☆50Updated 3 years ago
- Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper☆135Updated 2 years ago