Alternatives and similar repositories for Pitfalls-of-Memorization

Users that are interested in Pitfalls-of-Memorization are comparing it to the libraries listed below

• VectorInstitute / vectorlm
  LLM finetuning in resource-constrained environments.
  ☆54Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆88Updated 2 years ago
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆106Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• r-three / mats
  ☆32Updated last year
• google-research / jax-influence
  ☆63Updated 3 years ago
• hlml / fortuitous_forgetting
  ☆19Updated 3 years ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆28Updated last month
• AnanyaKumar / transfer_learning
  Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…
  ☆152Updated 2 years ago
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆61Updated 4 years ago
• js-d / sim_metric
  ☆37Updated 2 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• RobertCsordas / onion_representations
  ☆12Updated last year
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• RobertCsordas / modules
  The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…
  ☆46Updated 2 years ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆113Updated last month
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• nitarshan / robust-generalization-measures
  Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)
  ☆28Updated 5 years ago
• google-deepmind / distribution_shift_framework
  This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…
  ☆84Updated 2 weeks ago
• google-deepmind / emergent_in_context_learning
  ☆85Updated last year
• guy-dar / embedding-space
  ☆56Updated 2 years ago
• RAIVNLab / supsup
  Code for "Supermasks in Superposition"
  ☆124Updated 2 years ago
• gregorbachmann / scaling_mlps
  ☆52Updated last year
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆37Updated 3 years ago
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆42Updated 10 months ago
• dtsip / in-context-learning
  ☆242Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆86Updated last year
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆74Updated 4 years ago