LydiaXiaohongLi / Albert_Finetune_with_Pretrain_on_Custom_CorpusLinks
1. Pretrain Albert on custom corpus 2. Finetune the pretrained Albert model on downstream task
☆33Updated 5 years ago
Alternatives and similar repositories for Albert_Finetune_with_Pretrain_on_Custom_Corpus
Users that are interested in Albert_Finetune_with_Pretrain_on_Custom_Corpus are comparing it to the libraries listed below
Sorting:
- Minimal Interactive Attention Visualization☆140Updated 5 years ago
- A tutorial of pertaining Bert on your own dataset using google TPU☆44Updated 5 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 6 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- architectures and pre-trained models for long document classification.☆154Updated 4 years ago
- Enhancing the BERT training with Semi-supervised Generative Adversarial Networks☆229Updated 2 years ago
- Code for paper "Hierarchical Text Classification with Reinforced Label Assignment" EMNLP 2019☆137Updated 4 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆152Updated 5 years ago
- IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models☆182Updated 4 years ago
- A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.☆96Updated 4 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆121Updated 4 years ago
- Named Entity Recognition with Pretrained XLM-RoBERTa☆92Updated 4 years ago
- Visualize BERT's self-attention layers on text classification tasks☆47Updated 6 years ago
- This repository contains various ways to calculate sentence vector similarity using NLP models☆198Updated 5 years ago
- Code for unsupervised aspect extraction, using Keras and its Backends☆91Updated 2 years ago
- Using BERT For Classifying Documents with Long Texts, check my latest post: https://armandolivares.tech/☆41Updated 6 years ago
- X-Transformer: Taming Pretrained Transformers for eXtreme Multi-label Text Classification☆141Updated 4 years ago
- Tensorflow and Keras implementation of the state of the art researches in Dialog System NLU☆100Updated 4 years ago
- reference pytorch code for named entity tagging☆87Updated last year
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 3 years ago
- Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).☆79Updated 5 years ago
- Rank-based Unsupervised Keyword Extraction via Metavertex Aggregation☆99Updated last year
- Fine-tune BERT to generate sentence embedding for cosine similarity☆69Updated 6 years ago
- Implementation of paper "Learning to Encode Text as Human-Readable Summaries using GAN"☆65Updated 6 years ago
- Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in …☆126Updated 5 years ago
- Summarization Task using Bart and T5 models.☆172Updated 5 years ago
- ☆42Updated 5 years ago
- PyTorch implementation of 'An Unsupervised Neural Attention Model for Aspect Extraction' by He et al. ACL2017'☆66Updated 4 years ago
- PyTorch port of BERT ML model☆17Updated 6 years ago
- Python code for various NLP metrics☆169Updated 6 years ago