Pea-KD: Parameter-efficient and accurate knowledge distillation on BERT (PLOS One)
☆35Aug 22, 2025Updated 6 months ago
Alternatives and similar repositories for Pea-KD
Users that are interested in Pea-KD are comparing it to the libraries listed below
Sorting:
- ☆33Dec 9, 2022Updated 3 years ago
- SensiMix: Sensitivity-Aware 8-bit Index & 1-bit Value Mixed Precision Quantization for BERT Compression (PLOS One)☆34Aug 22, 2025Updated 6 months ago
- Sturctured pruning algorithm for pruning Transformer☆31Dec 6, 2023Updated 2 years ago
- Vector multiplication on Low-rank Matrix Factorization☆46Nov 10, 2023Updated 2 years ago
- Falcon: Lightweight and Accurate Convolution Based on Depthwise Separable Convolution (KAIS)☆45Aug 22, 2025Updated 6 months ago
- PET: Parameter-efficient Knowledge Distillation on Transformer (PLOS One)☆15Aug 22, 2025Updated 6 months ago
- Flexible Convolutional Neural Network☆23Nov 15, 2023Updated 2 years ago
- SynQ: Accurate Zero-shot Quantization by Synthesis-aware Fine-tuning (ICLR 2025)☆26Feb 7, 2025Updated last year
- Accurate Retraining-free Pruning for Pretrained Encoder-based Language Models (ICLR 2024)☆14May 31, 2025Updated 9 months ago
- A dataset repository of "Accurate Action Recommendation for Smart Home via Two-Level Encoders and Commonsense Knowledge" (CIKM 2022)☆16Aug 20, 2025Updated 6 months ago
- Accurate Node Feature Estimation with Structured Variational Graph Autoencoder (KDD 2022)☆19Apr 6, 2023Updated 2 years ago
- ☆13Dec 13, 2022Updated 3 years ago
- Implementation of LaViC (KDD 2025)☆12Jun 1, 2025Updated 9 months ago
- 커버리스트 - 북 커버 생성 AI 서비스☆13Sep 11, 2022Updated 3 years ago
- Cascading Residual Graph Convolutional Network for Multi-Behavior Recommendation☆16Dec 31, 2023Updated 2 years ago
- This is a reproduction of the paper 'Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications wit…☆13Aug 22, 2021Updated 4 years ago
- SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters (ICLR 2025)☆17Aug 22, 2025Updated 6 months ago
- Fast and Accurate Partial Fourier Transform for Time Series Data (KDD 2021)☆16Aug 19, 2025Updated 6 months ago
- AI grand challenge 2020 Repo (Speech Recognition Track)☆22Oct 17, 2022Updated 3 years ago
- ☆18May 10, 2021Updated 4 years ago
- An introductory graduate course on "Computer Vision for Embedded Systems"☆20Jun 12, 2022Updated 3 years ago
- MBCGCN☆16Oct 13, 2022Updated 3 years ago
- Image-to-image translation in PyTorch (e.g. horse2zebra, edges2cats, and more)☆16Aug 8, 2017Updated 8 years ago
- Official Implementation of "D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusion"☆24Oct 29, 2023Updated 2 years ago
- ☆19Sep 21, 2023Updated 2 years ago
- torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.☆24Mar 29, 2024Updated last year
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 4 years ago
- official code for EMNLP21 paper☆36Dec 14, 2021Updated 4 years ago
- The model implementations for T5 encoder decoder soft prompt tuning for text generation.☆25Dec 5, 2022Updated 3 years ago
- 케라스로 만드는 Seq2Seq 챗봇☆22Nov 15, 2021Updated 4 years ago
- An implementation on "Curved-Voxel Clustering for Accurate Segmentation of 3D LiDAR Point Clouds with Real-Time Performance" from IROS 20…☆241Jan 25, 2022Updated 4 years ago
- Official Code for SIGIR 2022 "A Multi-task Based Neural Model to Simulate Users in Goal Oriented Dialogue Systems". User Simulator genera…☆37Jul 14, 2022Updated 3 years ago
- KorQuAD (Korean Question Answering Dataset) submission guide using PyTorch pretrained BERT☆31Jun 18, 2019Updated 6 years ago
- [ECCV 2024] AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizer☆42Dec 9, 2024Updated last year
- Implementation of ALS algorithm from "Collaborative Filtering for Implicit Feedback Data"☆42Aug 13, 2023Updated 2 years ago
- 소프트웨어 개발의 원리와 실습☆27Dec 21, 2020Updated 5 years ago
- ☆37Dec 23, 2020Updated 5 years ago
- Precursor-of-Anomaly Detection☆10Oct 25, 2024Updated last year
- AutoRAG example about benchmarking Korean embeddings.☆43Oct 2, 2024Updated last year