Alternatives and similar repositories for RegularizedBN

Users that are interested in RegularizedBN are comparing it to the libraries listed below

• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last month
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆52Updated 2 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 9 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated 10 months ago
• gregorbachmann / scaling_mlps
  ☆51Updated last year
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆34Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated 2 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆62Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• sanagno / adaptively_sparse_attention
  ☆21Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• shoaibahmed / llm_depth_pruning
  Official implementation of the paper: "A deeper look at depth pruning of LLMs"
  ☆15Updated 11 months ago
• alexrame / diwa
  DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization
  ☆31Updated 2 years ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• dydjw9 / Efficient_SAM
  ☆58Updated 2 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆47Updated 2 years ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆56Updated 2 years ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 2 months ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated 2 months ago
• joshr17 / IFM
  Code for paper "Can contrastive learning avoid shortcut solutions?" NeurIPS 2021.
  ☆47Updated 3 years ago
• VITA-Group / instant_soup
  [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…
  ☆11Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆45Updated 2 years ago
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 4 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆26Updated 9 months ago
• TomerRonen34 / mixed-resolution-vit
  ☆51Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆31Updated 2 years ago
• LukasHedegaard / structured-pruning-adapters
  Structured Pruning Adapters in PyTorch
  ☆18Updated last year