Alternatives and similar repositories for condensed-sparsity:

Users that are interested in condensed-sparsity are comparing it to the libraries listed below

• szc12153 / sparse_meta_tuning
  Official implementation for Sparse MetA-Tuning (SMAT)
  ☆16Updated 9 months ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆28Updated last year
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• gregorbachmann / scaling_mlps
  ☆51Updated 10 months ago
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆12Updated last month
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆28Updated last year
• taesiri / ZoomIsAllYouNeed
  Official code and data for NeurIPS 2023 paper "ImageNet-Hard: The Hardest Images Remaining from a Study of the Power of Zoom and Spatial …
  ☆38Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆29Updated 10 months ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated 2 years ago
• MarlonBecker / MSAM
  ☆18Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated 8 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆65Updated 6 months ago
• SamsungSAILMontreal / PAPA
  Repository for the PopulAtion Parameter Averaging (PAPA) paper
  ☆26Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated last year
• SamsungSAILMontreal / ghn3
  Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]
  ☆32Updated 7 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆28Updated 10 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆20Updated 2 months ago
• JoelNiklaus / loss_landscape
  Code for visualizing the loss landscape of neural nets
  ☆10Updated 4 years ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆53Updated 7 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆47Updated last year
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• jongwooko / distillm-2
  ☆9Updated last month