Alternatives and similar repositories for SparseBERT:

Users that are interested in SparseBERT are comparing it to the libraries listed below

• bywmm / Bi-GCN
  Implementation of "Binary Graph Convolutional Network", CVPR 2021, and TPAMI 2024.
  ☆24Updated 11 months ago
• camlsys / degree-quant
  ICLR 2021
  ☆47Updated 4 years ago
• han-shi / SparseBERT
  ☆13Updated 2 years ago
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆96Updated 2 years ago
• ShunLu91 / PINAT
  [AAAI '23] PINAT: A Permutation INvariance Augmented Transformer for NAS Predictor
  ☆31Updated 2 years ago
• sunggo / APIB
  Code for ICCV23 paper "Automatic network pruning via Hilbert Schmidt independence criterion lasso under information bottleneck principle"
  ☆18Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆43Updated 2 years ago
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆46Updated last year
• mbahri / binary_gnn
  Code for our paper "Binary Graph Neural Networks", CVPR 2021
  ☆37Updated 3 years ago
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆32Updated 2 years ago
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆89Updated last year
• shaoyiHusky / SparseProgressiveDistillation
  ☆12Updated last year
• decemberzhou / TF_TAS
  ☆36Updated 2 years ago
• xiusu / NAS-Bench-Macro
  NAS Benchmark in "Prioritized Architecture Sampling with Monto-Carlo Tree Search", CVPR2021
  ☆38Updated 3 years ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆52Updated last year
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• A-suozhang / Papers-of-NAS
  Personal Digest of NAS (Under Construction 🛠)
  ☆25Updated 4 years ago
• ziplab / SAQ
  This is the official PyTorch implementation for "Sharpness-aware Quantization for Deep Neural Networks".
  ☆42Updated 3 years ago
• szhangtju / The-compression-of-Transformer
  ☆64Updated 4 years ago
• yanghr / BSQ
  BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)
  ☆40Updated 4 years ago
• gmum / Zero-Time-Waste
  ☆13Updated last year
• ShunLu91 / PA-DA
  [CVPR '23] PA&DA: Jointly Sampling PAth and DAta for Consistent NAS
  ☆36Updated 2 years ago
• XueFuzhao / WideNet_Code
  Implementation of AAAI 2022 Paper: Go wider instead of deeper
  ☆32Updated 2 years ago
• z-hXu / ReCU
  Pytorch implementation of our paper accepted by ICCV 2021 -- ReCU: Reviving the Dead Weights in Binary Neural Networks http://arxiv.org/a…
  ☆38Updated 3 years ago
• cornell-zhang / dnn-gating
  Conditional channel- and precision-pruning on neural networks
  ☆73Updated 5 years ago
• ultmaster / neuralpredictor.pytorch
  Open source reproduction in PyTorch of "Neural Predictor for Neural Architecture Search".
  ☆40Updated 4 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆196Updated last year
• iamkanghyunchoi / qimera
  Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples [NeurIPS 2021]
  ☆31Updated 3 years ago
• IST-DASLab / spdy
  Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"
  ☆18Updated last year
• peiswang / BitSplit
  BitSplit Post-trining Quantization
  ☆49Updated 3 years ago