snudm-starlab / Pea-KDView external linksLinks
Pea-KD: Parameter-efficient and accurate knowledge distillation on BERT (PLOS One)
☆35Aug 22, 2025Updated 5 months ago
Alternatives and similar repositories for Pea-KD
Users that are interested in Pea-KD are comparing it to the libraries listed below
Sorting:
- ☆13Dec 13, 2022Updated 3 years ago
- 커버리스트 - 북 커버 생성 AI 서비스☆13Sep 11, 2022Updated 3 years ago
- Locust on k8s example for scalable load tests☆14Apr 16, 2022Updated 3 years ago
- This is a reproduction of the paper 'Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications wit…☆13Aug 22, 2021Updated 4 years ago
- SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters (ICLR 2025)☆17Aug 22, 2025Updated 5 months ago
- Pytorch implementation of our paper accepted by ECCV 2022-- Fine-grained Data Distribution Alignment for Post-Training Quantization☆15Sep 13, 2022Updated 3 years ago
- 발화자 지정 모듈☆21Feb 14, 2025Updated last year
- ☆18May 10, 2021Updated 4 years ago
- torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.☆23Mar 29, 2024Updated last year
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 4 years ago
- The model implementations for T5 encoder decoder soft prompt tuning for text generation.☆25Dec 5, 2022Updated 3 years ago
- official code for EMNLP21 paper☆36Dec 14, 2021Updated 4 years ago
- 케라스로 만드는 Seq2Seq 챗봇☆22Nov 15, 2021Updated 4 years ago
- Official Code for SIGIR 2022 "A Multi-task Based Neural Model to Simulate Users in Goal Oriented Dialogue Systems". User Simulator genera…☆37Jul 14, 2022Updated 3 years ago
- KorQuAD (Korean Question Answering Dataset) submission guide using PyTorch pretrained BERT☆31Jun 18, 2019Updated 6 years ago
- Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"☆40May 1, 2025Updated 9 months ago
- ☆40Dec 16, 2023Updated 2 years ago
- ☆37Dec 23, 2020Updated 5 years ago
- AutoRAG example about benchmarking Korean embeddings.☆43Oct 2, 2024Updated last year
- Attentive Neural Controlled Differential Equations for Time-series Classification and Forecasting☆45Nov 8, 2023Updated 2 years ago
- A clean and structured implementation of the RNN family with wandb and pytorch-lightning☆48May 21, 2022Updated 3 years ago
- Simple llama usage example☆47Mar 10, 2023Updated 2 years ago
- ☆46Jan 26, 2024Updated 2 years ago
- ReConsider is a re-ranking model that re-ranks the top-K (passage, answer-span) predictions of an Open-Domain QA Model like DPR (Karpukhi…☆49Apr 26, 2021Updated 4 years ago
- ELECTRA기반 한국어 대화체 언어모델☆53Aug 4, 2021Updated 4 years ago
- Source code for paper "Learning from Noisy Labels for Entity-Centric Information Extraction", EMNLP 2021☆55Dec 11, 2021Updated 4 years ago
- ☆61Sep 18, 2025Updated 4 months ago
- The code for lifelong few-shot language learning☆55Feb 17, 2022Updated 4 years ago
- official implementation of Generative Low-bitwidth Data Free Quantization(GDFQ)☆55Jul 23, 2023Updated 2 years ago
- PyTorch Transformer from scratch: BERT, ELECTRA pretraining, and Ko→En translation.☆54Jan 12, 2026Updated last month
- Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation (NAACL 2022)☆65Mar 17, 2023Updated 2 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆63Mar 29, 2025Updated 10 months ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆62Jan 22, 2022Updated 4 years ago
- Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)☆54Jun 12, 2023Updated 2 years ago
- 추천시스템 논문을 읽고 구현한 Code가 저장된 Repository☆66Feb 26, 2023Updated 2 years ago
- 특허분야 특화된 한국어 AI언어모델 KorPatBERT☆67Jan 31, 2024Updated 2 years ago
- [DEPRECATED] 광운대학교 KLAS 사이트에 편리한 기능을 추가할 수 있는 유저 스크립트☆66Apr 15, 2023Updated 2 years ago
- An easy way to fine-tune Wav2Vec 2.0 for low-resource languages.☆80May 20, 2023Updated 2 years ago
- This repo Implements "Dense Passage Retrieval for Open-Domain Question Answering" using Korean Dataset☆75Oct 21, 2022Updated 3 years ago