Alternatives and similar repositories for gradient-information-optimization

Users that are interested in gradient-information-optimization are comparing it to the libraries listed below

• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• adymaharana / d2pruning
  ☆43Updated 2 years ago
• milesaturpin / cot-unfaithfulness
  ☆51Updated 2 years ago
• MadryLab / DsDm
  ☆51Updated last year
• mmatena / model_merging
  ☆80Updated 3 years ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆19Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated 2 years ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆133Updated last year
• avalonstrel / Mitigating-the-Alignment-Tax-of-RLHF
  ☆16Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆82Updated 11 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆48Updated last year
• cambridgeltl / zepo
  Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)
  ☆13Updated last year
• TRAIS-Lab / dattri
  `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
  ☆95Updated last week
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆23Updated 8 months ago
• alon-albalak / online-data-mixing
  An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.
  ☆13Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 7 months ago
• chujiezheng / LLM-MCQ-Bias
  Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"
  ☆42Updated 6 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆29Updated last year
• r-three / smear
  ☆30Updated 2 years ago
• lingchen0331 / UQ_ICL
  Uncertainty quantification for in-context learning of large language models
  ☆16Updated last year
• zepingyu0512 / in-context-mechanism
  code for EMNLP 2024 paper: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for M…
  ☆13Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• roeehendel / icl_task_vectors
  ☆102Updated 2 years ago
• r-three / mats
  ☆32Updated last year
• hartvigsen-group / composable-interventions
  ☆29Updated 9 months ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated 2 years ago
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆12Updated 10 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 10 months ago
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆77Updated last year