Alternatives and similar repositories for gradient-information-optimization

Users that are interested in gradient-information-optimization are comparing it to the libraries listed below

• adymaharana / d2pruning
  ☆35Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated last year
• mmatena / model_merging
  ☆66Updated 3 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• cambridgeltl / zepo
  Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)
  ☆13Updated 7 months ago
• TaiMingLu / know-dont-tell
  ☆14Updated 7 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 3 weeks ago
• lingchen0331 / UQ_ICL
  Uncertainty quantification for in-context learning of large language models
  ☆16Updated last year
• MadryLab / DsDm
  ☆49Updated last year
• zepingyu0512 / in-context-mechanism
  code for EMNLP 2024 paper: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for M…
  ☆11Updated 6 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆17Updated last year
• Olivia-fsm / DoGE
  Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"
  ☆17Updated last year
• chujiezheng / LLM-MCQ-Bias
  Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"
  ☆38Updated 11 months ago
• 2003pro / TAGCOS
  This is the official implementation of TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data
  ☆10Updated 9 months ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆11Updated 3 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]
  ☆12Updated 3 months ago
• Jiachen-T-Wang / GREATS
  ☆13Updated last month
• adamxyang / laplace-lora
  Bayesian low-rank adaptation for large language models
  ☆23Updated last year
• 2003pro / ScaleBiO
  This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
  ☆18Updated 9 months ago
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated 2 years ago
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆21Updated last month
• r-three / mats
  ☆30Updated 10 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 8 months ago
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆53Updated 2 years ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆38Updated 4 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆23Updated 3 months ago