LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_Corpus
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 4 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus:
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆63Updated 4 years ago
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆31Updated last year
- ☆42Updated 4 years ago
- a Fairseq fork for sequence tagging/labeling tasks☆31Updated 4 years ago
- Use-cases of Hugging Face's BERT (e.g. paraphrase generation, unsupervised extractive summarization).☆20Updated 5 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆79Updated 2 years ago
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 4 years ago
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆129Updated 3 years ago
- PyTorch port of BERT ML model☆16Updated 6 years ago
- ☆68Updated 3 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 5 years ago
- ☆29Updated 2 years ago
- source code of bison☆26Updated 4 years ago
- A long version of BART model based on Longformer model☆23Updated last year
- A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.☆47Updated 2 years ago
- ☆22Updated 3 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- Dataset and baseline for ACL 2019 paper "XQA: A Cross-lingual Open-domain Question Answering Dataset"☆89Updated 3 years ago
- EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering☆38Updated 3 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- Tools for training pytorch language models☆27Updated 4 years ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 4 years ago
- ☆33Updated 2 years ago
- Implementation of paper "Learning to Encode Text as Human-Readable Summaries using GAN"☆66Updated 5 years ago
- Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"☆56Updated 4 months ago
- Unsupervised sentence summarization by contextual matching☆47Updated 3 years ago
- ☆25Updated 4 years ago
- Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.☆72Updated 3 years ago
- Named Entity Recognition on CoNLL dataset using BiLSTM+CRF implemented with Pytorch☆41Updated 5 years ago
- Selections from EMNLP 2020☆59Updated 3 years ago