复现论文《Distilling Task-Specific Knowledge from BERT into Simple Neural Networks》
☆16Jun 13, 2021Updated 5 years ago
Alternatives and similar repositories for distill_BERT_into_RNN-CNN
Users that are interested in distill_BERT_into_RNN-CNN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆15Aug 28, 2020Updated 5 years ago
- ☆10Aug 29, 2022Updated 3 years ago
- 基于Pytorch的知识蒸馏（中文文本分类）☆23Jan 12, 2023Updated 3 years ago
- Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。☆234Jul 27, 2022Updated 4 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- BERT distillation（基于BERT的蒸馏实验 ）☆316Jul 30, 2020Updated 5 years ago
- Robust Federated Learning for Large Language Models in Adversarial Wireless Environments☆16Mar 7, 2025Updated last year
- Membership Inference Attack on Federated Learning☆13Jan 14, 2022Updated 4 years ago
- LSTM and Word2Vec based classification on Reuters-21578 dataset☆14Nov 21, 2022Updated 3 years ago
- PyTorch implementation of Near-Lossless Post-Training Quantization of Deep Neural Networks via a Piecewise Linear Approximation☆23Feb 17, 2020Updated 6 years ago
- Image and text encryption using Shamir's Secret Sharing algorithm☆14Feb 17, 2020Updated 6 years ago
- ☆16Aug 29, 2023Updated 2 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现☆29Mar 3, 2020Updated 6 years ago
- ☆11May 2, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 三大boosting算法的工程实现 XGBoost、LightGBM、Catboost原理实现及常见面试问题总结，以及其他理解深刻的机器学习、深度学习文章备份☆12Jul 7, 2021Updated 5 years ago
- ☆24Jul 25, 2024Updated 2 years ago
- TextGuard: Provable Defense against Backdoor Attacks on Text Classification☆15Nov 7, 2023Updated 2 years ago
- python metric functions, such as MAP, NDCG, AUC...☆10Jul 25, 2014Updated 12 years ago
- 🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pyto…☆66Oct 6, 2023Updated 2 years ago
- 最新pytorch分布式训练，单机多卡，多机多卡整理（多GPU）☆18Mar 25, 2024Updated 2 years ago
- reinforcement learning for optimal debt collection strategy☆11Dec 8, 2019Updated 6 years ago
- Text Classification using 15 Deep Learning Models with both Multi-Label and Single-Label Task.☆12Mar 12, 2020Updated 6 years ago
- huggingface ChineseBert Tokenizer☆16Apr 16, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the official Gtihub repo for our paper: "BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Lang…☆23Jul 3, 2024Updated 2 years ago
- 采用bert进行事件抽取，[cls]进行事件分类，最后一层向量进行序列标注，两个任务同时训练。☆12Jun 7, 2021Updated 5 years ago
- Using pre-trained DL models and Transformations for generating occupancy maps. Includes some other basic deep learning tasks. Feel free t…☆14Jul 15, 2020Updated 6 years ago
- Template Filling with Generative Transformers☆22Jun 8, 2021Updated 5 years ago
- 受到self-instruct启发,除了通用LLM还能做垂直领域的小LLM实现定制效果，通过GPT获得question和answer来作为训练数据☆18May 12, 2023Updated 3 years ago
- 2021搜狐校园文本匹配算法大赛☆16Jun 4, 2021Updated 5 years ago
- Skip-Thought Vectors implement by tensorflow☆11Mar 6, 2018Updated 8 years ago
- Implementation of semi-supervised learning: UDA, MixMatch, Mean-teacher, focusing on NLP, powered by Pytorch☆12Jan 6, 2021Updated 5 years ago
- A pytorch implementation of LCGNN☆12Jun 1, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- chinese NLP dataset☆18Nov 6, 2020Updated 5 years ago
- Bot for Minecraft environment☆13Jun 18, 2019Updated 7 years ago
- This is an official implementation for the ICLR2023 paper "The Best of Both Worlds: Accurate Global and Personalized Models through Feder…☆24Mar 4, 2025Updated last year
- ARMA cell: a modular and effective approach for neural autoregressive modeling☆16May 29, 2024Updated 2 years ago
- Various implementations and experimentation for deep neural network model compression☆24Sep 6, 2018Updated 7 years ago
- ☆21Sep 20, 2022Updated 3 years ago
- Implementation of the paper "Exploring the Universal Vulnerability of Prompt-based Learning Paradigm" on Findings of NAACL 2022☆32Jul 11, 2022Updated 4 years ago