nsfzyzz / Generalization_metrics_for_NLP
[KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arxiv.org/pdf/2202.02842.pdf
☆12Updated 2 years ago
Alternatives and similar repositories for Generalization_metrics_for_NLP:
Users that are interested in Generalization_metrics_for_NLP are comparing it to the libraries listed below
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆34Updated 2 weeks ago
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆101Updated last year
- ☆34Updated last year
- Efficient empirical NTKs in PyTorch☆18Updated 2 years ago
- Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)☆28Updated 2 years ago
- Welcome to the 'In Context Learning Theory' Reading Group☆27Updated 5 months ago
- ☆67Updated 4 months ago
- ☆16Updated 2 years ago
- Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J☆68Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated 10 months ago
- ☆66Updated 3 years ago
- Code for the ICLR 2022 paper. Salient Imagenet: How to discover spurious features in deep learning?☆40Updated 2 years ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆19Updated 2 months ago
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆71Updated 2 weeks ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆47Updated last year
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆31Updated 4 years ago
- Neural Tangent Kernel Papers☆108Updated 3 months ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆145Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆57Updated last month
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- Localizing Memorized Sequences in Language Models☆12Updated last month
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆75Updated 2 years ago
- Influence Analysis and Estimation - Survey, Papers, and Taxonomy☆77Updated last year
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 5 years ago
- A simple PyTorch implementation of influence functions.☆85Updated 10 months ago
- A fast, effective data attribution method for neural networks in PyTorch☆204Updated 5 months ago
- ☆21Updated 8 months ago