Alternatives and similar repositories for Beyond-Neural-Scaling:

Users that are interested in Beyond-Neural-Scaling are comparing it to the libraries listed below

• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆55Updated last year
• dydjw9 / Efficient_SAM
  ☆57Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• tding1 / Neural-Collapse
  [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features
  ☆53Updated 2 years ago
• mansheej / data_diet
  ☆104Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 7 months ago
• google-research / head2toe
  ☆81Updated 5 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆49Updated last year
• zzp1012 / LLFC
  [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"
  ☆17Updated last year
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆25Updated last year
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆73Updated 3 years ago
• Saehyung-Lee / DCC
  This repository is the official implementation of Dataset Condensation with Contrastive Signals (DCC), accepted at ICML 2022.
  ☆20Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated last year
• mpagli / Agree-to-Disagree
  Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"
  ☆35Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆27Updated last year
• alexrame / diwa
  DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization
  ☆29Updated last year
• mmatena / model_merging
  ☆63Updated 2 years ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆133Updated 10 months ago
• JeanKaddour / WASAM
  Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)
  ☆28Updated 2 years ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated last year
• MadryLab / dataset-interfaces
  Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation
  ☆44Updated last year
• pluskid / structural-regularity
  ☆22Updated last year
• google-research / understanding-curricula
  ☆34Updated 5 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆22Updated 8 months ago
• modestyachts / cifar-10.2
  Host CIFAR-10.2 Data Set
  ☆13Updated 3 years ago
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆29Updated 6 months ago
• Weixin-Liang / MetaShift
  MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)
  ☆109Updated 2 years ago
• nblt / RWP
  ☆11Updated 2 years ago