Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models.
☆20Nov 19, 2024Updated last year
Alternatives and similar repositories for transformers-icl-second-order
Users that are interested in transformers-icl-second-order are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Interpretable Diffusion Via Information Decomposition☆29Jul 18, 2024Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆26Jan 12, 2024Updated 2 years ago
- ☆17Oct 14, 2026Updated 3 weeks ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- ☆13Apr 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Memory-Based Meta-Learning on Non-Stationary Distributions☆19Mar 14, 2024Updated 2 years ago
- ☆13Aug 13, 2024Updated 2 years ago
- Tensorflow implementation of MuZero algorithm☆11Aug 23, 2022Updated 4 years ago
- ☆14Aug 8, 2026Updated 2 months ago
- ☆18Jan 9, 2025Updated last year
- Automatic differentiation through persistence diagrams with PyTorch☆19May 28, 2024Updated 2 years ago
- Source code for ICML 2022 paper "A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalization".☆10Jun 19, 2022Updated 4 years ago
- ☆13Apr 13, 2026Updated 6 months ago
- ☆11Aug 21, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Sep 25, 2025Updated last year
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆21May 2, 2024Updated 2 years ago
- ☆31Sep 7, 2023Updated 3 years ago
- Source code for ICML 2023 paper "Competing for Shareable Arms in Multi-Player Multi-Armed Bandits"☆10May 14, 2024Updated 2 years ago
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆19Jun 27, 2024Updated 2 years ago
- ☆13Aug 2, 2023Updated 3 years ago
- ☆10Jul 27, 2026Updated 3 months ago
- ☆14Jul 13, 2025Updated last year
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆21Jul 27, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- ☆16May 24, 2026Updated 5 months ago
- Official Pytorch implementation of Chromatic Graph Transformers☆10Jun 14, 2023Updated 3 years ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 3 years ago
- A codebase for ACL 2023 paper: Mitigating Label Biases for In-context Learning☆10Aug 4, 2023Updated 3 years ago
- [ICLR'26] Beyond Linear Probes: Dynamic Safety Monitoring for Language Models☆13Oct 1, 2025Updated last year
- Code for paper "Why Do Transformers Fail to Forecast Time Series In-Context?"☆14Oct 15, 2025Updated last year
- Blog on formalizing key transformer invariants.☆26Sep 15, 2026Updated last month
- Real-time design blueprint review editor☆17Nov 21, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆19Jul 15, 2026Updated 3 months ago
- Official python implementation for ICML 2024: "Learning Solution-Aware Transformers for Efficiently Solving Quadratic Assignment Problem"☆17Jul 1, 2024Updated 2 years ago
- Least Squares Regression for subspace clustering☆11May 27, 2018Updated 8 years ago
- MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248☆64Jun 18, 2024Updated 2 years ago
- Code for paper: End-to-end Stochastic Optimization with Energy-based Model☆16Feb 14, 2023Updated 3 years ago
- An implementation of a Brownian motion using ClojureScript with re-frame and Highcharts☆11Feb 8, 2019Updated 7 years ago
- ☆13Jul 24, 2024Updated 2 years ago