Alternatives and similar repositories for condensed-sparsity:

Users that are interested in condensed-sparsity are comparing it to the libraries listed below

• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆27Updated 8 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆27Updated last year
• gregorbachmann / scaling_mlps
  ☆51Updated 8 months ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆51Updated 5 months ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆32Updated last year
• VITA-Group / SFW-Once-for-All-Pruning
  [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…
  ☆29Updated 3 years ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 6 months ago
• sjunhongshen / DASH
  ☆21Updated 2 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• SamsungSAILMontreal / PAPA
  Repository for the PopulAtion Parameter Averaging (PAPA) paper
  ☆26Updated 10 months ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• TomerRonen34 / mixed-resolution-vit
  ☆50Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 8 months ago
• shikaiqiu / compute-better-spent
  ☆52Updated 4 months ago
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago
• szc12153 / sparse_meta_tuning
  Official implementation for Sparse MetA-Tuning (SMAT)
  ☆16Updated 7 months ago
• epfml / pam
  ☆14Updated last year
• Sharath-girish / LilNetX
  Official PyTorch implementation of LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
  ☆46Updated 2 years ago
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆53Updated last year
• swiss-ai / MoE
  some mixture of experts architecture implementations
  ☆12Updated 10 months ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆21Updated 3 years ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆24Updated 7 months ago
• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML'24)
  ☆29Updated 6 months ago
• facebookresearch / Data_Acquisition_for_ML_Benchmark
  DAM Data Acquisition for ML Benchmark, as part of the DataPerf benchmark suite, https://dataperf.org/
  ☆23Updated last year