Alternatives and similar repositories for gradient-information-optimization:

Users that are interested in gradient-information-optimization are comparing it to the libraries listed below

• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• adymaharana / d2pruning
  ☆32Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated 10 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆16Updated last year
• mmatena / model_merging
  ☆65Updated 2 years ago
• Liuhong99 / implicitbiasmlmcode
  ☆11Updated last year
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆35Updated 8 months ago
• MadryLab / DsDm
  ☆46Updated last year
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆22Updated 8 months ago
• Olivia-fsm / DoGE
  Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"
  ☆15Updated last year
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆43Updated last year
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]
  ☆11Updated last month
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated 2 years ago
• adamxyang / laplace-lora
  Bayesian low-rank adaptation for large language models
  ☆22Updated 9 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆23Updated 9 months ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• shizhediao / Black-Box-Prompt-Learning
  Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"
  ☆55Updated last year
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆12Updated 8 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 9 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆72Updated 2 months ago
• Model-GLUE / Model-GLUE
  ☆11Updated 6 months ago
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated last year
• Hritikbansal / jpo
  ☆12Updated 2 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆37Updated 10 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated last month
• formll / resolving-scaling-law-discrepancies
  ☆17Updated 7 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆22Updated 5 months ago
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆19Updated 4 months ago
• dannyallover / overthinking_the_truth
  ☆30Updated 10 months ago