Alternatives and similar repositories for SparseBERT:

Users that are interested in SparseBERT are comparing it to the libraries listed below

• bywmm / Bi-GCN
  Implementation of "Binary Graph Convolutional Network", CVPR 2021, and TPAMI 2024.
  ☆25Updated last year
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆96Updated 2 years ago
• camlsys / degree-quant
  ICLR 2021
  ☆48Updated 4 years ago
• yuchaoli / PST
  Source code for IJCAI 2022 Long paper: Parameter-Efficient Sparsity for Large Language Models Fine-Tuning.
  ☆14Updated 2 years ago
• han-shi / SparseBERT
  ☆13Updated 2 years ago
• VITA-Group / GraNet
  [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration
  ☆31Updated 2 years ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• varun19299 / rigl-reproducibility
  Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020
  ☆28Updated 3 years ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆49Updated last year
• Shiweiliuiiiiiii / In-Time-Over-Parameterization
  [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…
  ☆45Updated last year
• shaoyiHusky / SparseProgressiveDistillation
  ☆12Updated last year
• boone891214 / GaP
  ICLR'22, Effective Model Sparsification by Scheduled Grow-and-Prune Methods
  ☆8Updated 2 years ago
• cornell-zhang / dnn-gating
  Conditional channel- and precision-pruning on neural networks
  ☆73Updated 5 years ago
• htqin / BiBERT
  This project is the official implementation of our accepted ICLR 2022 paper BiBERT: Accurate Fully Binarized BERT.
  ☆88Updated last year
• htqin / DSG
  This project is the official implementation of our accepted IEEE TPAMI paper Diverse Sample Generation: Pushing the Limit of Data-free Qu…
  ☆14Updated 2 years ago
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆18Updated 6 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆20Updated 3 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• sIncerass / QBERT
  ☆15Updated 2 years ago
• hikaru-nara / DASK
  This is the official implmentation of Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data (IJCAI 2022 Long …
  ☆11Updated 2 years ago
• aojunzz / DominoSearch
  ☆18Updated 3 years ago
• decemberzhou / TF_TAS
  ☆38Updated 2 years ago
• GATECH-EIC / ShiftAddViT
  [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  ☆32Updated last year
• yanghr / BSQ
  BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)
  ☆40Updated 4 years ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• szhangtju / The-compression-of-Transformer
  ☆64Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• IST-DASLab / spdy
  Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"
  ☆18Updated 2 years ago
• liuzechun / AdamBNN
  How Do Adam and Training Strategies Help BNNs Optimization? In ICML 2021.
  ☆60Updated 3 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆79Updated 4 years ago