Alternatives and similar repositories for RegularizedBN

Users that are interested in RegularizedBN are comparing it to the libraries listed below

• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆56Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆54Updated 2 years ago
• mmatena / model_merging
  ☆73Updated 3 years ago
• berlino / gated_linear_attention
  ☆106Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• roymiles / VeLoRA
  [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections
  ☆21Updated 10 months ago
• naotoo1 / Beyond-Neural-Scaling
  Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models
  ☆34Updated last month
• jongwooko / distillm-2
  Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)
  ☆36Updated 2 months ago
• r-three / mats
  ☆31Updated last year
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 4 months ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆176Updated last year
• r-three / smear
  ☆30Updated last year
• dydjw9 / Efficient_SAM
  ☆58Updated 2 years ago
• VijayLingam95 / SVFT
  ☆31Updated 6 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆61Updated 2 years ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆53Updated last year
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆74Updated 4 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 2 months ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• LukasHedegaard / structured-pruning-adapters
  Structured Pruning Adapters in PyTorch
  ☆19Updated 2 years ago
• juntang-zhuang / GSAM
  PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)
  ☆144Updated 3 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆67Updated 11 months ago
• tanganke / opcm
  ☆16Updated 7 months ago
• alexrame / diwa
  DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization
  ☆31Updated 2 years ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆124Updated 2 weeks ago