Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher model. Reduced the size of the original BERT by 40%.
☆26Feb 13, 2021Updated 5 years ago
Alternatives and similar repositories for Question-Answering-with-BERT-and-Knowledge-Distillation
Users that are interested in Question-Answering-with-BERT-and-Knowledge-Distillation are comparing it to the libraries listed below
Sorting:
- Use BERT for Question Answering and finetune train with SQuAD 2.0☆15Oct 12, 2019Updated 6 years ago
- ☆19Apr 5, 2022Updated 3 years ago
- NER with Deep contextualized word representations (Elmo)☆23Jul 22, 2018Updated 7 years ago
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆35Aug 19, 2021Updated 4 years ago
- Workshop on Text Classification at 1729 Conference☆13Sep 4, 2022Updated 3 years ago
- This repository shows how to implement a basic model for multimodal entailment.☆10Aug 17, 2021Updated 4 years ago
- generate spot-it cards☆10Jun 13, 2015Updated 10 years ago
- Code for the CIKM 2019 Paper: How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations☆32Jun 12, 2023Updated 2 years ago
- solutions for advent of code 2018☆17Dec 19, 2018Updated 7 years ago
- Code for "Contextualized Embeddings in Named-Entity Recognition", ECIR 2020☆13Jul 25, 2024Updated last year
- ☆10Oct 17, 2021Updated 4 years ago
- assignments and group case studies from PGDMLAI course by upGrad & IIITB☆13Aug 7, 2023Updated 2 years ago
- ☆10Aug 22, 2022Updated 3 years ago
- Data and code for analyzing Movie Lead Gender.☆10Apr 13, 2016Updated 9 years ago
- ICNet in TensorFlow, Real-Time Segmentation☆10Aug 17, 2018Updated 7 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 5 years ago
- ☆10Jul 27, 2020Updated 5 years ago
- ggwave package for the Swift Package Manager☆15Jan 19, 2023Updated 3 years ago
- Non-blocking sockets wrapper☆17Aug 23, 2025Updated 6 months ago
- This project shows how to build a simple handwriting recognizer in Keras with the IAM dataset.☆13Aug 15, 2021Updated 4 years ago
- Optimized for 8Gb inference LTX-2 audio–video generative model. + Web UI. Model created by:☆27Updated this week
- Ideas on how to quickly learn to build command-line tools☆11Feb 26, 2022Updated 4 years ago
- Python 3 runtime libraries for ANTLR 4☆13Jun 7, 2015Updated 10 years ago
- Pytorch Implementation of RetinaNet with CUDA accelerate nms operation.☆10Jul 8, 2019Updated 6 years ago
- J.A.R.V.I.S is a very advanced virtual assistant who can automate almost all tasks of everything of PC & IoT. Just Say It.☆11Jul 29, 2021Updated 4 years ago
- Code and data necessary to reproduce heatmaps relating HN Submission time to submission score.☆13Jul 10, 2015Updated 10 years ago
- All the code developed in the "Creating Google Cloud Pub/Sub publishers and subscribers with Spring Cloud GCP" article.☆10May 25, 2023Updated 2 years ago
- Guess the Hacker News titles☆12Mar 24, 2022Updated 3 years ago
- Sequence Tagging for Biomedical Extractive Question Answering (Bioinformatics'2020)☆11Jul 3, 2023Updated 2 years ago
- This project demonstrates the use of Deep Learning to detect emotion (sad, angry, happy etc) from the images of faces.☆11Feb 14, 2020Updated 6 years ago
- Python/numpy/pandas convenience wrapper for the TIMIT database.☆11Nov 26, 2018Updated 7 years ago
- Simple Tool Box with Pytorch☆10Jan 27, 2021Updated 5 years ago
- Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.☆11Apr 22, 2020Updated 5 years ago
- 🏆 Ambassador Paper for Innovative Use of NLP for Building Educational Applications 2023: Is ChatGPT a Good Teacher Coach? Measuring Zero…☆14Jul 21, 2024Updated last year
- ☆10Apr 16, 2021Updated 4 years ago
- Implements RNNPool and SoftPool for CNNs.☆14Jan 29, 2021Updated 5 years ago
- ☆13Jun 24, 2024Updated last year
- Very basic Flask application with an interactive form, using Flask-WTF and Flask-Bootstrap☆11Mar 26, 2017Updated 8 years ago