LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_Corpus
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 4 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus:
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 5 years ago
- ☆42Updated 4 years ago
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆31Updated last year
- Use-cases of Hugging Face's BERT (e.g. paraphrase generation, unsupervised extractive summarization).☆20Updated 5 years ago
- ☆28Updated 5 years ago
- reference pytorch code for intent classification☆44Updated 5 months ago
- EmbedRank implemented in Python.☆15Updated 9 months ago
- Annotated corpus and code for "Extracting COVID-19 Events from Twitter".☆45Updated 2 years ago
- Entity extraction using BERT + CRF for single-tun / multi-turn setting in dialogues☆30Updated 3 years ago
- An implementation of transformer-based language model for sentence rewriting tasks such as summarization, simplification, and grammatical…☆29Updated 8 months ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 4 years ago
- Selections from EMNLP 2020☆59Updated 3 years ago
- Uses GloVe embeddings and greedy sequence segmentation to semantically segment a text document into any number of k segments.☆32Updated 6 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling☆71Updated 2 years ago
- A simple version of DeepRank & MatchPyramid implemented in PyTorch.☆35Updated 4 years ago
- Text Classification using transformer based models☆24Updated 4 years ago
- Source code for our AAAI 2020 paper P-SIF: Document Embeddings using Partition Averaging☆34Updated 4 years ago
- ☆29Updated 2 years ago
- Zero-shot Transfer Learning from English to Arabic☆29Updated 2 years ago
- Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.☆72Updated 3 years ago
- Code and resources for the paper "BERT-QE: Contextualized Query Expansion for Document Re-ranking".☆50Updated 3 years ago
- ☆34Updated 2 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆80Updated 2 years ago
- PyTorch port of BERT ML model☆16Updated 6 years ago
- ☆40Updated 4 years ago
- Fine-tune BERT to generate sentence embedding for cosine similarity☆69Updated 5 years ago
- A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.☆47Updated 2 years ago
- reference pytorch code for named entity tagging☆85Updated 5 months ago
- PyTorch implementation of 'An Unsupervised Neural Attention Model for Aspect Extraction' by He et al. ACL2017'☆66Updated 3 years ago