daeveraert / gradient-information-optimization
Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection
☆12Updated last year
Alternatives and similar repositories for gradient-information-optimization:
Users that are interested in gradient-information-optimization are comparing it to the libraries listed below
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆74Updated last year
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆61Updated 3 months ago
- ☆62Updated 2 years ago
- ☆11Updated last year
- ☆31Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆22Updated 4 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆72Updated last month
- ☆43Updated 5 months ago
- This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)☆100Updated 2 years ago
- Bayesian low-rank adaptation for large language models☆22Updated 8 months ago
- ☆29Updated 8 months ago
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆18Updated 3 months ago
- ☆28Updated 6 months ago
- ☆48Updated last year
- ☆27Updated 2 months ago
- AI Logging for Interpretability and Explainability🔬☆100Updated 7 months ago
- ☆34Updated 11 months ago
- ☆26Updated 11 months ago
- Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"☆15Updated 11 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆89Updated 3 years ago
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated 8 months ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- ☆46Updated last year
- ☆86Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆21Updated 7 months ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆49Updated last year
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆43Updated last year
- ☆52Updated last year
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆38Updated last year