Alternatives and similar repositories for SparseBERT:

Users that are interested in SparseBERT are comparing it to the libraries listed below

• bywmm / Bi-GCN
  Implementation of "Binary Graph Convolutional Network", CVPR 2021, and TPAMI 2024.
  ☆24Updated 9 months ago
• shaoyiHusky / SparseProgressiveDistillation
  ☆12Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆43Updated 2 years ago
• Cydia2018 / ViT-cifar10-pruning
  Vision Transformer Pruning
  ☆54Updated 3 years ago
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆90Updated last year
• han-shi / SparseBERT
  ☆13Updated 2 years ago
• camlsys / degree-quant
  ICLR 2021
  ☆46Updated 3 years ago
• yuchaoli / PST
  Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.
  ☆13Updated 2 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• IST-DASLab / spdy
  Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"
  ☆18Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆97Updated 2 years ago
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆31Updated last year
• szhangtju / The-compression-of-Transformer
  ☆63Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆85Updated last year
• sunggo / APIB
  Code for ICCV23 paper "Automatic network pruning via Hilbert Schmidt independence criterion lasso under information bottleneck principle"
  ☆17Updated last year
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆84Updated 2 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆21Updated 3 years ago
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆96Updated last year
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 4 years ago
• LorrinWWW / SkipBERT
  Code associated with the paper **SkipBERT: Efficient Inference with Shallow Layer Skipping**, at ACL 2022
  ☆16Updated 2 years ago
• AnTuo1998 / AE-KD
  ☆26Updated 3 years ago
• cornell-zhang / dnn-gating
  Conditional channel- and precision-pruning on neural networks
  ☆72Updated 4 years ago
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆181Updated last year
• varun19299 / rigl-reproducibility
  Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020
  ☆27Updated 3 years ago
• htqin / DSG
  This project is the official implementation of our accepted IEEE TPAMI paper Diverse Sample Generation: Pushing the Limit of Data-free Qu…
  ☆14Updated last year
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆46Updated last year
• robeld / ERNIE
  Open Source Neural Machine Translation in PyTorch
  ☆17Updated 5 years ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆72Updated last year