nsfzyzz / Generalization_metrics_for_NLPLinks
[KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arxiv.org/pdf/2202.02842.pdf
☆12Updated 2 years ago
Alternatives and similar repositories for Generalization_metrics_for_NLP
Users that are interested in Generalization_metrics_for_NLP are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated 2 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- Efficient empirical NTKs in PyTorch☆18Updated 3 years ago
- Localizing Memorized Sequences in Language Models☆16Updated 3 months ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆156Updated this week
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆102Updated 2 years ago
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 7 months ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆22Updated 4 months ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated last year
- ☆69Updated 3 years ago
- ☆68Updated 6 months ago
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆77Updated 2 weeks ago
- ☆34Updated last year
- A fast, effective data attribution method for neural networks in PyTorch☆211Updated 7 months ago
- Codebase for Linguistic Collapse: Neural Collapse in (Large) Language Models [NeurIPS 2024] [arXiv:2405.17767]☆13Updated 2 months ago
- A simple PyTorch implementation of influence functions.☆88Updated last year
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- AI Logging for Interpretability and Explainability🔬☆123Updated last year
- ☆31Updated 11 months ago
- Influence Analysis and Estimation - Survey, Papers, and Taxonomy☆79Updated last year
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆47Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 3 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆70Updated 8 months ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 4 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated 11 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆45Updated 8 months ago
- Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J☆69Updated last year
- [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs☆13Updated last week
- Code accompanying the paper "Massive Activations in Large Language Models"☆164Updated last year