LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_CorpusLinks
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 5 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
Sorting:
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- Minimal Interactive Attention Visualization☆140Updated 5 years ago
- architectures and pre-trained models for long document classification.☆155Updated 4 years ago
- IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models☆179Updated 4 years ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 5 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- This repository contains various ways to calculate sentence vector similarity using NLP models☆198Updated 5 years ago
- BERT which stands for Bidirectional Encoder Representations from Transformations is the SOTA in Transfer Learning in NLP.☆56Updated 5 years ago
- A long version of BART model based on Longformer model☆23Updated 2 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networks☆229Updated 2 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆120Updated 4 years ago
- Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)☆32Updated 2 years ago
- ☆32Updated 2 years ago
- ☆87Updated 3 years ago
- Code for unsupervised aspect extraction, using Keras and its Backends☆91Updated 2 years ago
- Using BERT For Classifying Documents with Long Texts, check my latest post: https://armandolivares.tech/☆41Updated 5 years ago
- Evaluation script for named entity recognition (NER) systems based on entity-level F1 score.☆70Updated 4 years ago
- Evidence-based QA system for community question answering.☆106Updated 4 years ago
- A library to conduct ranking experiments with transformers.☆160Updated 2 years ago
- Summarization Task using Bart and T5 models.☆171Updated 5 years ago
- The PyTorch implementation the Smooth Grad [https://arxiv.org/pdf/1706.03825.pdf] and Integrated Gradients [https://arxiv.org/pdf/1703.01…☆46Updated 4 years ago
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 5 years ago
- A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.☆96Updated 4 years ago
- Code and resources for the paper "BERT-QE: Contextualized Query Expansion for Document Re-ranking".☆50Updated 3 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 2 years ago
- Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).☆79Updated 4 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆152Updated 4 years ago
- a Fairseq fork for sequence tagging/labeling tasks☆31Updated 5 years ago
- BERT for question answering starting with HotpotQA☆167Updated 6 years ago
- NoiseMix - data generation for natural language☆40Updated 7 years ago