Alternatives and similar repositories for condensed-sparsity:

Users that are interested in condensed-sparsity are comparing it to the libraries listed below

• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆25Updated 7 months ago
• gregorbachmann / scaling_mlps
  ☆51Updated 7 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆50Updated 4 months ago
• szc12153 / sparse_meta_tuning
  Official implementation for Sparse MetA-Tuning (SMAT)
  ☆16Updated 6 months ago
• SamsungSAILMontreal / PAPA
  Repository for the PopulAtion Parameter Averaging (PAPA) paper
  ☆26Updated 9 months ago
• swiss-ai / MoE
  some mixture of experts architecture implementations
  ☆12Updated 9 months ago
• SamsungSAILMontreal / ghn3
  Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]
  ☆30Updated 4 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆23Updated 6 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆18Updated last year
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"
  ☆17Updated last week
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆27Updated last year
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆11Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆58Updated 3 months ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated last year
• JoelNiklaus / loss_landscape
  Code for visualizing the loss landscape of neural nets
  ☆10Updated 4 years ago
• IST-DASLab / RoSA
  ☆38Updated 11 months ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆25Updated last year
• snu-mllab / LayerMerge
  Official PyTorch implementation of "LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging" (ICML'24)
  ☆29Updated 5 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 5 months ago
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆46Updated 11 months ago
• mlfoundations / dataset2metadata
  ☆22Updated 9 months ago
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆19Updated 5 months ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆18Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆27Updated last year