mansheej / icl-task-diversity
Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"
☆20Updated last year
Related projects ⓘ
Alternatives and complementary repositories for icl-task-diversity
- ☆58Updated 2 years ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆104Updated 3 months ago
- ☆13Updated 6 months ago
- ☆26Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- ☆59Updated 3 years ago
- ☆26Updated 3 weeks ago
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- ☆76Updated 9 months ago
- ☆25Updated 4 months ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 4 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆69Updated last year
- ☆50Updated 6 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆19Updated 5 months ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆95Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆85Updated 3 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆18Updated 3 years ago
- Efficient empirical NTKs in PyTorch☆16Updated 2 years ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆47Updated last year
- ☆18Updated last month
- ☆33Updated 9 months ago
- Test-time-training on nearest neighbors for large language models☆27Updated 7 months ago
- A library for efficient patching and automatic circuit discovery.☆31Updated last month
- ☆21Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- NanoGPT-like codebase for LLM training☆75Updated this week
- ☆63Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆54Updated 2 weeks ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆53Updated last month