Alternatives and similar repositories for Pitfalls-of-Memorization

Users that are interested in Pitfalls-of-Memorization are comparing it to the libraries listed below

• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• hlml / fortuitous_forgetting
  ☆19Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆28Updated last year
• VectorInstitute / vectorlm
  LLM finetuning in resource-constrained environments.
  ☆51Updated last year
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆41Updated 8 months ago
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆106Updated last year
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆61Updated 4 years ago
• guy-dar / embedding-space
  ☆55Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆87Updated 2 years ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆109Updated 5 months ago
• shauli-ravfogel / rlace-icml
  ☆36Updated 3 years ago
• gregorbachmann / Next-Token-Failures
  ☆103Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• mcleish7 / gemstone-scaling-laws
  Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)
  ☆29Updated last month
• DeqingFu / transformers-icl-second-order
  Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…
  ☆19Updated 11 months ago
• mmatena / model_merging
  ☆78Updated 3 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆84Updated last year
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆93Updated last month
• fattorib / Flax-ResNets
  CIFAR10 ResNets implemented in JAX+Flax
  ☆12Updated 3 years ago
• r-three / mats
  ☆31Updated last year
• gibipara92 / learning-explanations-hard-to-vary
  Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …
  ☆41Updated 4 years ago
• RobertCsordas / modules
  The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…
  ☆46Updated 2 years ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆17Updated 6 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆28Updated 4 months ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• kaistAI / factual-knowledge-acquisition
  ☆23Updated 2 months ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 3 years ago