Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher model. Reduced the size of the original BERT by 40%.
☆26Feb 13, 2021Updated 5 years ago
Alternatives and similar repositories for Question-Answering-with-BERT-and-Knowledge-Distillation
Users that are interested in Question-Answering-with-BERT-and-Knowledge-Distillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Use BERT for Question Answering and finetune train with SQuAD 2.0☆15Oct 12, 2019Updated 7 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- BERT based pretrained model using SQuAD 2.0 Dataset for Question-Answering☆29Mar 19, 2021Updated 5 years ago
- ☆13Aug 29, 2020Updated 6 years ago
- Seq2Seq workshop materials☆15Mar 16, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- In this repository, I will try to solve interview questions that are mostly about probability theory and stats.☆15Feb 4, 2022Updated 4 years ago
- ☆17Jan 31, 2025Updated last year
- 자연어 처리 기반 [한글 서술형 수학문제 데이터셋] 공개 저장소입니다.☆14Jun 12, 2023Updated 3 years ago
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆36Aug 19, 2021Updated 5 years ago
- ☆14Oct 16, 2024Updated 2 years ago
- This repo contains demo code notebooks accompanying the AIPI 540: Deep Learning Applications course in Duke University's Master of Engine…☆46Dec 9, 2024Updated last year
- huggingface-based implementation of an open question answering model trained on the newsqa dataset.☆23Feb 6, 2023Updated 3 years ago
- The implementation of "RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question" [ACL 2023]☆17Apr 7, 2024Updated 2 years ago
- ☆92Sep 29, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Reading comprehension with ALBERT transformer model☆15Dec 14, 2021Updated 4 years ago
- Bidirectional Encoder Representations from Transformers (BERT) transfer learning for named entity recognition and de-identification of se…☆10Aug 3, 2019Updated 7 years ago
- A novel BERT model with online Elastic Weight Loss that learns and consolidates information to mimic memory while minimizing catastrophic…☆10Jul 25, 2024Updated 2 years ago
- Build end-to-end Machine Learning pipeline to predict accessibility of playgrounds in NYC☆15Jul 9, 2020Updated 6 years ago
- Facebook Hatebook Memes Challenge☆12Jan 28, 2021Updated 5 years ago
- Toxic Comment Classification on Wikipedia Comments dataset.☆10May 5, 2019Updated 7 years ago
- This is project to analyze korquad 2.0☆23Jun 22, 2022Updated 4 years ago
- Cross-platform file sharig application for desktop and mobile devices☆11May 2, 2024Updated 2 years ago
- assignments and group case studies from PGDMLAI course by upGrad & IIITB☆13Aug 7, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- python-to-triton-llm☆10Aug 25, 2025Updated last year
- MFAQ: a Multilingual FAQ Dataset☆18Aug 5, 2026Updated 2 months ago
- 基于OpenAI CLIP模型构建的高性能图像分类系统，支持： - **零样本分类**：无需训练直接识别新类别 - **定制化微调**：适配特定业务场景 - **分布式部署**：高并发生产级推理方案☆12Jul 5, 2025Updated last year
- PHP with FPM Dockerfile for trusted automated Docker builds.☆12Mar 2, 2016Updated 10 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 6 years ago
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Dec 27, 2024Updated last year
- Sample data generated by Synthea☆16Oct 21, 2026Updated last week
- Code for the CIKM 2019 Paper: How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations☆32Jun 12, 2023Updated 3 years ago
- ☆11Jul 17, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A simple summary of fine-grained sentiment analysis☆12Dec 10, 2021Updated 4 years ago
- [IEEE RA-L'26] LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields☆15Oct 15, 2026Updated 2 weeks ago
- An Image construct which takes care of building & pushing docker images for cdk8s☆23Updated this week
- Training T5 to perform numerical reasoning.☆23Jun 4, 2021Updated 5 years ago
- Docker GPU 算力资源管理平台☆16Sep 28, 2026Updated last month
- Text summarization with python and transformer☆13Jun 17, 2023Updated 3 years ago
- implementation of text to speech models☆13May 25, 2026Updated 5 months ago