⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
☆315Jun 12, 2023Updated 3 years ago
Alternatives and similar repositories for BERT-of-Theseus
Users that are interested in BERT-of-Theseus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- tensorflow version of bert-of-theseus☆62Dec 11, 2020Updated 5 years ago
- The score code of FastBERT (ACL2020)☆605Oct 29, 2021Updated 5 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,710May 8, 2023Updated 3 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆202Sep 20, 2019Updated 7 years ago
- bert-of-theseus via bert4keras☆31Jul 17, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,167Jan 22, 2024Updated 2 years ago
- ☆15Sep 10, 2019Updated 7 years ago
- Prune a model while finetuning or training.☆409Jun 21, 2022Updated 4 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,258Mar 7, 2024Updated 2 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,116May 9, 2024Updated 2 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,658Updated this week
- Code for the paper "Are Sixteen Heads Really Better than One?"☆175Apr 1, 2020Updated 6 years ago
- BERT distillation（基于BERT的蒸馏实验 ）☆316Jul 30, 2020Updated 6 years ago
- DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference☆160Mar 25, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆221Jun 8, 2020Updated 6 years ago
- An Implementation of Bidirectional Attention Flow☆39Sep 6, 2017Updated 9 years ago
- 对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf☆191Dec 15, 2021Updated 4 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆66Jun 19, 2021Updated 5 years ago
- MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices☆73May 19, 2020Updated 6 years ago
- Repo for EMNLP 2021 paper "Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression"☆10Sep 4, 2021Updated 5 years ago
- Knowledge Distillation from BERT☆54Jan 7, 2019Updated 7 years ago
- TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)☆534May 19, 2021Updated 5 years ago
- ICML'2022: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework☆258Jan 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Baseline code for NAACL 2021 paper "Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge"☆21Jul 6, 2021Updated 5 years ago
- Open Language Pre-trained Model Zoo☆1,002Nov 18, 2021Updated 4 years ago
- a bert for retrieval and generation☆860Feb 26, 2021Updated 5 years ago
- Adversarial Training for Natural Language Understanding☆252Sep 6, 2023Updated 3 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,646Apr 19, 2026Updated 6 months ago
- using bilstm-crf,bert and other methods to do sequence tagging task☆413Jun 12, 2023Updated 3 years ago
- This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"☆1,623Jun 12, 2023Updated 3 years ago
- IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization☆12Nov 23, 2021Updated 4 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,986Nov 21, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for the ACL2021 paper "Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter"☆345Jan 15, 2022Updated 4 years ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,796Jul 22, 2024Updated 2 years ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,552Jul 18, 2025Updated last year
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"☆49May 25, 2022Updated 4 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆727Aug 29, 2022Updated 4 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,191May 28, 2023Updated 3 years ago
- MASKER: Masked Keyword Regularization for Reliable Text Classification (AAAI 2021)☆54Oct 4, 2023Updated 3 years ago