MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
☆73May 19, 2020Updated 6 years ago
Alternatives and similar repositories for MobileBert_PyTorch
Users that are interested in MobileBert_PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ECIR'21: Simplified TinyBERT: Knowledge Distillation for Document Retrieval☆17Apr 25, 2021Updated 5 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Jun 12, 2023Updated 3 years ago
- CLUE baseline pytorch CLUE的pytorch版本基线☆75Apr 3, 2020Updated 6 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆271Oct 24, 2020Updated 5 years ago
- Chinese MobileBERT(中文MobileBERT模型)☆99Mar 2, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- pytorch implement of NovoGrad Optimizer☆21Mar 8, 2022Updated 4 years ago
- Semi-supervised Domain Adaptation of Machine Translation☆12Dec 8, 2022Updated 3 years ago
- Step wise instructions to integrate the power of BERT with Fastai☆18Jul 17, 2019Updated 7 years ago
- Bootstrapping loss function implementation in pytorch☆36Dec 3, 2020Updated 5 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆60Jun 1, 2020Updated 6 years ago
- 基于prompt learning的NLP算法,涉及文本分类、信息抽取等☆15Jan 12, 2023Updated 3 years ago
- Tuning BERT☆10Jun 28, 2022Updated 4 years ago
- pytorch implement of Label Smoothing☆32Dec 16, 2019Updated 6 years ago
- IEEE Investment Ranking Challenge solution (4th place)☆10Jun 1, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- tensorflow version of bert-of-theseus☆62Dec 11, 2020Updated 5 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆202Sep 20, 2019Updated 6 years ago
- ☆12Oct 10, 2021Updated 4 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Aug 24, 2021Updated 5 years ago
- A temporary repo to share the DMBERT code for Event Detection☆13Apr 19, 2020Updated 6 years ago
- No Gabut Challenge Submission☆10Mar 2, 2021Updated 5 years ago
- ☆259Oct 4, 2022Updated 3 years ago
- Training HuggingFace models using fastai☆11Jul 22, 2021Updated 5 years ago
- 基于BERT的预训练语言模型实现,分为两步:预训练和微调。目前已包括BERT、Roberta、ALbert三个模型,且皆可支持Whole Word Mask模式。☆17Feb 1, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for EMNLP2020 long paper: BERT-Attack: Adversarial Attack Against BERT Using BERT☆207Sep 22, 2020Updated 5 years ago
- DIY_resnet+迁移学习+风格迁移☆18May 20, 2019Updated 7 years ago
- Hybrid vectors e.g. mixed boxed/unboxed vectors that are suitable for use with vector-algorithms☆14Aug 29, 2025Updated last year
- Training with Block Minifloat number representation☆18May 2, 2021Updated 5 years ago
- ☆17Sep 10, 2021Updated 4 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆191Dec 15, 2021Updated 4 years ago
- 🔐 A simple two-factor authentication app, built with React Native.☆11Jan 29, 2023Updated 3 years ago
- 自然语言处理中的序列标注实现☆12Sep 16, 2018Updated 7 years ago
- A Lite Bert For Self-Supervised Learning Language Representations☆714May 13, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,166Jan 22, 2024Updated 2 years ago
- A PyTorch-based toolkit for natural language processing☆160Mar 10, 2023Updated 3 years ago
- 西班牙短文本匹配比赛,初赛8/1027,复赛5/1027☆19Aug 1, 2018Updated 8 years ago
- Source code for ACL 2022 paper "Self-contrastive Decorrelation for Sentence Embeddings".☆26Mar 10, 2025Updated last year
- Tool for slot extraction from text☆15Oct 23, 2022Updated 3 years ago
- BiLSTM+CRF by Pytorch and classic CRF by pysuite 基于双向循环神经网络和CRF特征模板的信息抽取☆17Jan 9, 2019Updated 7 years ago
- pytorch版unilm模型☆25Jun 19, 2021Updated 5 years ago