Alternatives and similar repositories for SparseBERT

Users that are interested in SparseBERT are comparing it to the libraries listed below

• bywmm / Bi-GCN
  Implementation of "Binary Graph Convolutional Network", CVPR 2021, and TPAMI 2024.
  ☆26Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• camlsys / degree-quant
  ICLR 2021
  ☆48Updated 4 years ago
• szhangtju / The-compression-of-Transformer
  ☆64Updated 4 years ago
• NiuTrans / NASPapers
  Paper lists of neural architecture search (NAS)
  ☆134Updated 3 years ago
• shaoyiHusky / SparseProgressiveDistillation
  ☆12Updated last year
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆190Updated 2 years ago
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆31Updated 2 years ago
• robeld / ERNIE
  Open Source Neural Machine Translation in PyTorch
  ☆17Updated 6 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆196Updated 2 years ago
• weihai-98 / A-2Q
  ☆10Updated last year
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• cornell-zhang / dnn-gating
  Conditional channel- and precision-pruning on neural networks
  ☆72Updated 5 years ago
• Cydia2018 / ViT-cifar10-pruning
  Vision Transformer Pruning
  ☆57Updated 3 years ago
• pyyush / GraphML
  PyTorch implementation of "Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks"
  ☆14Updated 2 years ago
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆98Updated 2 years ago
• kssteven418 / I-BERT
  [ICML'21 Oral] I-BERT: Integer-only BERT Quantization
  ☆253Updated 2 years ago
• han-shi / SparseBERT
  ☆13Updated 2 years ago
• yanghr / BSQ
  BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)
  ☆40Updated 4 years ago
• rycolab / differentiable-subset-pruning
  ☆15Updated 3 years ago
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆19Updated 6 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆335Updated last year
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆49Updated 2 years ago
• yuchaoli / PST
  Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.
  ☆14Updated 3 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆189Updated 2 years ago
• vinsis / ternary-quantization
  Training models with ternary quantized weights using PyTorch
  ☆13Updated 6 years ago
• mbahri / binary_gnn
  Code for our paper "Binary Graph Neural Networks", CVPR 2021
  ☆37Updated 4 years ago
• ShunLu91 / PINAT
  [AAAI '23] PINAT: A Permutation INvariance Augmented Transformer for NAS Predictor
  ☆31Updated 2 years ago
• gmum / Zero-Time-Waste
  ☆13Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆108Updated 3 years ago