automl / is_mamba_capable_of_icl
☆17Updated last year
Alternatives and similar repositories for is_mamba_capable_of_icl:
Users that are interested in is_mamba_capable_of_icl are comparing it to the libraries listed below
- ☆31Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆16Updated 5 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆36Updated last year
- What Makes a Reward Model a Good Teacher? An Optimization Perspective☆23Updated 2 weeks ago
- Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"☆29Updated last year
- ☆44Updated 2 years ago
- ☆28Updated last year
- ☆15Updated 5 months ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆54Updated 3 weeks ago
- ☆40Updated last year
- ☆13Updated 2 years ago
- Uncertainty quantification for in-context learning of large language models☆16Updated last year
- ☆25Updated last year
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated this week
- This is the project for IRM methods☆12Updated 3 years ago
- ☆31Updated 6 months ago
- ☆18Updated 9 months ago
- Code for NeurIPS'23 paper "A Bayesian Approach To Analysing Training Data Attribution In Deep Learning"☆17Updated last year
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆16Updated 3 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year
- Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…☆73Updated last year
- ☆30Updated 9 months ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated 2 weeks ago
- ☆18Updated last month
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆75Updated last year
- Official Repository for ICML 2023 paper "Can Neural Network Memorization Be Localized?"☆18Updated last year
- Test-time-training on nearest neighbors for large language models☆40Updated last year
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆66Updated 2 years ago
- Official Code for Local Search GFlowNets (ICLR 2024 Spotlight)☆17Updated last month
- [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization☆24Updated 3 months ago