Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher model. Reduced the size of the original BERT by 40%.
☆26Feb 13, 2021Updated 5 years ago
Alternatives and similar repositories for Question-Answering-with-BERT-and-Knowledge-Distillation
Users that are interested in Question-Answering-with-BERT-and-Knowledge-Distillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Use BERT for Question Answering and finetune train with SQuAD 2.0☆15Oct 12, 2019Updated 6 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- ☆19Apr 5, 2022Updated 4 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 4 years ago
- NER with Deep contextualized word representations (Elmo)☆23Jul 22, 2018Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Patient Letter Generation☆12Aug 22, 2024Updated last year
- [ACM MM 2023] The released code of paper "Deconfounded Visual Question Generation with Causal Inference"☆10Sep 3, 2024Updated last year
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆35Aug 19, 2021Updated 4 years ago
- Question-Directed Graph Attention Network for Numerical Reasoning over Text☆10Aug 14, 2020Updated 5 years ago
- ☆92Sep 29, 2021Updated 4 years ago
- The implementation of "RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question" [ACL 2023]☆17Apr 7, 2024Updated 2 years ago
- Re-Implementation of SPARTA model☆13Oct 1, 2021Updated 4 years ago
- Code for "Contextualized Embeddings in Named-Entity Recognition", ECIR 2020☆13Jul 25, 2024Updated last year
- ☆11Aug 21, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆15Dec 20, 2020Updated 5 years ago
- Bidirectional Encoder Representations from Transformers (BERT) transfer learning for named entity recognition and de-identification of se…☆10Aug 3, 2019Updated 6 years ago
- AudioVisual Diarization - Supervised and Unsupervised☆15Nov 22, 2022Updated 3 years ago
- Facebook Hatebook Memes Challenge☆12Jan 28, 2021Updated 5 years ago
- Simple test time augmentation (TTA) for keras python library.☆22Aug 8, 2018Updated 7 years ago
- Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth☆15Nov 26, 2025Updated 7 months ago
- ☆33Jun 2, 2026Updated last month
- This is project to analyze korquad 2.0☆23Jun 22, 2022Updated 4 years ago
- Official source code repository for QueryBlazer: Efficient Query Autocompletion Framework☆20Jun 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A novel BERT model with online Elastic Weight Loss that learns and consolidates information to mimic memory while minimizing catastrophic…☆10Jul 25, 2024Updated last year
- bilibili-nlp☆31Sep 24, 2022Updated 3 years ago
- Sample data generated by Synthea☆16Jun 30, 2026Updated 3 weeks ago
- Master's thesis project in collaboration with Rasa, focusing on knowledge distillation from BERT into different very small networks and a…☆13Sep 30, 2022Updated 3 years ago
- assignments and group case studies from PGDMLAI course by upGrad & IIITB☆13Aug 7, 2023Updated 2 years ago
- Speaker Diarization using GRU in PyTorch☆11Aug 29, 2020Updated 5 years ago
- A Tight-fisted Optimizer (Tiger), implemented in PyTorch.☆12Jun 26, 2024Updated 2 years ago
- A chatbot implemented using RNN and GloVe embeddings whch answers your query crazily☆12Jan 1, 2020Updated 6 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Anomaly Detection In An IoT-Acquired Environmental Sensor Data☆12Oct 2, 2018Updated 7 years ago
- Code accompanying AWS blog post "Build a Semantic Search Engine for Tabular Columns with Transformers and Amazon OpenSearch Service"☆18Nov 9, 2023Updated 2 years ago
- An unsupervised text summarization and information retrieval library under the hood using natural language processing models☆15Dec 11, 2020Updated 5 years ago
- ☆16Mar 9, 2024Updated 2 years ago
- Code for the CIKM 2019 Paper: How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations☆32Jun 12, 2023Updated 3 years ago
- 한글 단어 혹은 문장 이미지를 받아 텍스트를 반환하는 Text Recognition Model☆20Jun 14, 2020Updated 6 years ago
- A collection of my data science articles published in Towards Data Science and Towards AI.☆16Sep 19, 2025Updated 10 months ago