WeiHuang05 / Awesome_Large_Foundation_Model_TheoryLinks
Welcome to the 'In Context Learning Theory' Reading Group
☆29Updated 8 months ago
Alternatives and similar repositories for Awesome_Large_Foundation_Model_Theory
Users that are interested in Awesome_Large_Foundation_Model_Theory are comparing it to the libraries listed below
Sorting:
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆185Updated 6 months ago
- [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"☆13Updated 4 months ago
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆102Updated 2 years ago
- Neural Tangent Kernel Papers☆115Updated 6 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆332Updated this week
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆105Updated last week
- [ICLR 2025] "Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond"☆11Updated 4 months ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated 3 months ago
- A curated list of Model Merging methods.☆92Updated 10 months ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆37Updated last month
- This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…☆278Updated last year
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆45Updated 8 months ago
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆18Updated 10 months ago
- [ICML 2024] Code release for "On the Emergence of Cross-Task Linearity in Pretraining-Finetuning Paradigm"☆11Updated 4 months ago
- [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"☆35Updated 6 months ago
- summer school materials☆44Updated last year
- ☆233Updated last year
- Pytorch code for experiments on Linear Transformers☆21Updated last year
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆18Updated 2 years ago
- Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples☆38Updated 3 months ago
- This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆19Updated 4 months ago
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆32Updated 5 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆71Updated 9 months ago
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆137Updated 2 months ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated 11 months ago
- An effective weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study uncovering how reasoning length…☆12Updated last week
- Efficient empirical NTKs in PyTorch☆18Updated 3 years ago
- A curated list of resources for activation engineering☆91Updated last month
- ☆15Updated 10 months ago
- Papers about training data quality management for ML models.☆90Updated 2 weeks ago