JeanKaddour / NoTrainNoGain

Related projects ⓘ

Alternatives and complementary repositories for NoTrainNoGain

• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆56Updated 2 years ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆15Updated 5 months ago
• mmatena / model_merging
  ☆63Updated 2 years ago
• berlino / seq_icl
  ☆50Updated 6 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆53Updated last month
• activatedgeek / calibration-tuning
  ☆36Updated 3 months ago
• Qualcomm-AI-research / llm-surgeon
  ☆23Updated 5 months ago
• r-three / mats
  ☆25Updated 4 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• epfml / llm-baselines
  NanoGPT-like codebase for LLM training
  ☆75Updated this week
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆43Updated 6 months ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆54Updated 3 months ago
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆52Updated 11 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• formll / resolving-scaling-law-discrepancies
  ☆15Updated 4 months ago
• MadryLab / DsDm
  ☆43Updated 9 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆85Updated last year
• anadim / the-little-retrieval-test
  ☆31Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆91Updated last year
• Leiay / looped_transformer
  ☆20Updated 11 months ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• hadasah / btm
  ☆71Updated 6 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆94Updated 7 months ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆27Updated last year
• thunlp / Modularity-Analysis
  Repo for ACL2023 Findings paper "Emergent Modularity in Pre-trained Transformers"
  ☆20Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs?
  ☆25Updated 5 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆20Updated last week
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago