LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_CorpusLinks
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 5 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
Sorting:
- ☆42Updated 4 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 5 years ago
- PyTorch port of BERT ML model☆16Updated 6 years ago
- ☆28Updated 5 years ago
- Use-cases of Hugging Face's BERT (e.g. paraphrase generation, unsupervised extractive summarization).☆20Updated 5 years ago
- ☆32Updated 2 years ago
- Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation☆32Updated last year
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling☆47Updated 5 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Updated 4 years ago
- ☆40Updated 4 years ago
- A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.☆47Updated 2 years ago
- Named Entity Recognition as Dependency Parsing☆39Updated 4 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆121Updated 4 years ago
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆129Updated 3 years ago
- NoiseMix - data generation for natural language☆40Updated 7 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- Annotated corpus and code for "Extracting COVID-19 Events from Twitter".☆45Updated 3 years ago
- ☆25Updated 4 years ago
- ☆29Updated 3 years ago
- Uses GloVe embeddings and greedy sequence segmentation to semantically segment a text document into any number of k segments.☆33Updated 6 years ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 5 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 2 years ago
- ☆68Updated last month
- An implementation of transformer-based language model for sentence rewriting tasks such as summarization, simplification, and grammatical…☆29Updated 10 months ago
- Code for cross-sentence grammatical error correction using multilayer convolutional seq2seq models (ACL 2019)☆50Updated 5 years ago
- [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling☆71Updated 2 years ago
- This is the repository for SemEval 2021 Task 4: Reading Comprehension of Abstract Meaning. It includes code for baseline models and data.☆29Updated 3 years ago
- Fine-tune BERT to generate sentence embedding for cosine similarity☆69Updated 5 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆79Updated 2 years ago