wjxts / RegularizedBN

Related projects ⓘ

Alternatives and complementary repositories for RegularizedBN

• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week
• yikangshen / MoA
  Mixture of Attention Heads
  ☆39Updated 2 years ago
• VITA-Group / Lifelong-Learning-LTH
  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…
  ☆23Updated 2 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• sanagno / neurips_2022_statistics
  ☆17Updated 2 years ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆53Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆47Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆49Updated 3 months ago
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆22Updated last year
• polo5 / FDS
  Gradient-based Hyperparameter Optimization Over Long Horizons
  ☆12Updated 3 years ago
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 2 years ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• Noahs-ARK / RFA
  ☆32Updated 3 years ago
• LukasHedegaard / structured-pruning-adapters
  Structured Pruning Adapters in PyTorch
  ☆15Updated last year
• sanagno / adaptively_sparse_attention
  ☆17Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 2 years ago
• thu-ml / LM-Calibration
  ☆15Updated last year
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• Optimization-AI / fast_clip
  ☆19Updated last month
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆15Updated 5 months ago
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆20Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆29Updated last year
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆27Updated last year
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆72Updated 3 years ago
• dydjw9 / Efficient_SAM
  ☆58Updated last year