daeveraert / gradient-information-optimizationLinks
Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection
☆14Updated 2 years ago
Alternatives and similar repositories for gradient-information-optimization
Users that are interested in gradient-information-optimization are comparing it to the libraries listed below
Sorting:
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆75Updated last year
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated last year
- ☆35Updated last year
- Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"☆18Updated last year
- This is the official implementation of TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data☆10Updated 11 months ago
- ☆48Updated last year
- Uncertainty quantification for in-context learning of large language models☆16Updated last year
- ☆15Updated 10 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 2 months ago
- ☆49Updated last year
- ☆69Updated 3 years ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 5 months ago
- ☆28Updated 4 months ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆13Updated 8 months ago
- ☆31Updated 11 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆39Updated 5 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- In-context Example Selection with Influences☆15Updated 2 years ago
- ☆41Updated 8 months ago
- Code for paper: “What Data Benefits My Classifier?” Enhancing Model Performance and Interpretability through Influence-Based Data Selecti…☆23Updated last year
- ☆29Updated last year
- Learning adapter weights from task descriptions☆19Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆26Updated last year
- Bayesian low-rank adaptation for large language models☆23Updated last year
- Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888☆35Updated last year
- ☆40Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆27Updated 9 months ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆46Updated last year
- ☆16Updated 3 months ago
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆25Updated 7 months ago