autoliuweijie / FastBERTView external linksLinks
The score code of FastBERT (ACL2020)
☆609Oct 29, 2021Updated 4 years ago
Alternatives and similar repositories for FastBERT
Users that are interested in FastBERT are comparing it to the libraries listed below
Sorting:
- 对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf☆193Dec 15, 2021Updated 4 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,698May 8, 2023Updated 2 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,156Jan 22, 2024Updated 2 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆162Mar 25, 2022Updated 3 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,986Nov 21, 2022Updated 3 years ago
- Source code of K-BERT (AAAI2020)☆981Jan 27, 2023Updated 3 years ago
- TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)☆535May 19, 2021Updated 4 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Jun 12, 2023Updated 2 years ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,772Jul 22, 2024Updated last year
- Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard☆1,786Feb 18, 2023Updated 2 years ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,439Jul 15, 2025Updated 6 months ago
- Open Language Pre-trained Model Zoo☆1,004Nov 18, 2021Updated 4 years ago
- a bert for retrieval and generation☆860Feb 26, 2021Updated 4 years ago
- 高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型☆816Jul 8, 2020Updated 5 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,649Jul 15, 2025Updated 6 months ago
- ☆279Dec 8, 2020Updated 5 years ago
- BERT distillation（基于BERT的蒸馏实验 ）☆314Jul 30, 2020Updated 5 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,230Feb 6, 2026Updated last week
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,173Jul 15, 2025Updated 6 months ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,542Jul 18, 2025Updated 6 months ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆229Sep 13, 2019Updated 6 years ago
- keras implement of transformers for humans☆5,421Nov 11, 2024Updated last year
- DeepIE: Deep Learning for Information Extraction☆1,944Dec 9, 2022Updated 3 years ago
- code for ACL 2020 paper: FLAT: Chinese NER Using Flat-Lattice Transformer☆1,005May 10, 2022Updated 3 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,370Mar 23, 2024Updated last year
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆121May 22, 2023Updated 2 years ago
- fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.☆3,143Jun 5, 2023Updated 2 years ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆542Dec 10, 2021Updated 4 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,177May 28, 2023Updated 2 years ago
- A Lite Bert For Self-Supervised Learning Language Representations☆715May 13, 2020Updated 5 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,643Oct 16, 2024Updated last year
- Facilitating the design, comparison and sharing of deep text matching models.☆3,851Aug 2, 2024Updated last year
- 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP☆9,858Feb 6, 2026Updated last week
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,419Jan 10, 2024Updated 2 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,257Mar 7, 2024Updated last year
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆731Aug 29, 2022Updated 3 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,123Nov 28, 2022Updated 3 years ago
- bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目☆1,848Mar 21, 2021Updated 4 years ago