LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_Corpus
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 4 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus:
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
- ☆42Updated 4 years ago
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆31Updated last year
- Code and resources for the paper "BERT-QE: Contextualized Query Expansion for Document Re-ranking".☆50Updated 3 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 5 years ago
- ☆28Updated 5 years ago
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆128Updated 3 years ago
- A simple version of DeepRank & MatchPyramid implemented in PyTorch.☆35Updated 4 years ago
- [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling☆71Updated 2 years ago
- CIKM 2020: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots☆74Updated 4 years ago
- ☆29Updated 2 years ago
- PyTorch port of BERT ML model☆16Updated 5 years ago
- The implementation of the papers on dual learning of natural language understanding and generation. (ACL2019,2020; Findings of EMNLP 2020…☆66Updated 4 years ago
- An implementation of transformer-based language model for sentence rewriting tasks such as summarization, simplification, and grammatical…☆29Updated 5 months ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆118Updated 3 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 5 years ago
- A long version of BART model based on Longformer model☆23Updated last year
- source code of bison☆26Updated 4 years ago
- NoiseMix - data generation for natural language☆40Updated 6 years ago
- Repo for EMNLP 2020 paper, "Improving Neural Topic Models using Knowledge Distillation"☆31Updated 4 years ago
- Named Entity Recognition on CoNLL dataset using BiLSTM+CRF implemented with Pytorch☆41Updated 5 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆63Updated 4 years ago
- ☆22Updated 3 years ago
- reference pytorch code for named entity tagging☆86Updated 3 months ago
- reference pytorch code for intent classification☆45Updated 3 months ago
- ☆30Updated 4 years ago
- ☆40Updated 4 years ago
- A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.☆46Updated 2 years ago