Alternatives and similar repositories for gradient-information-optimization

Users that are interested in gradient-information-optimization are comparing it to the libraries listed below

• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• mmatena / model_merging
  ☆80Updated 3 years ago
• MadryLab / DsDm
  ☆51Updated last year
• adymaharana / d2pruning
  ☆43Updated 2 years ago
• milesaturpin / cot-unfaithfulness
  ☆51Updated 2 years ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated 2 years ago
• lingchen0331 / UQ_ICL
  Uncertainty quantification for in-context learning of large language models
  ☆16Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆20Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 9 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆82Updated last year
• cambridgeltl / zepo
  Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)
  ☆14Updated last year
• Model-GLUE / Model-GLUE
  ☆18Updated last year
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• shizhediao / Black-Box-Prompt-Learning
  Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"
  ☆57Updated 2 years ago
• r-three / mats
  ☆32Updated last year
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆24Updated 9 months ago
• alon-albalak / online-data-mixing
  An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.
  ☆13Updated 2 years ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆51Updated 2 years ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆137Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆29Updated last year
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆61Updated 2 years ago
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆12Updated 11 months ago
• zepingyu0512 / in-context-mechanism
  code for EMNLP 2024 paper: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for M…
  ☆13Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆49Updated last year
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆51Updated last year
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆104Updated 3 years ago
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆32Updated 2 weeks ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆31Updated last year