princeton-nlp / TransformerProgramsLinks
[NeurIPS 2023] Learning Transformer Programs
☆161Updated last year
Alternatives and similar repositories for TransformerPrograms
Users that are interested in TransformerPrograms are comparing it to the libraries listed below
Sorting:
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆135Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆91Updated 3 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆181Updated last year
- ☆82Updated last year
- ☆159Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆80Updated 3 years ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- A repository for transformer critique learning and generation☆90Updated last year
- ☆45Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆24Updated last year
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆106Updated last year
- ☆85Updated last year
- Inspecting and Editing Knowledge Representations in Language Models☆116Updated last year
- ☆72Updated last year
- ☆52Updated last year
- ☆34Updated last year
- ☆117Updated 10 months ago
- ☆179Updated last year
- ☆84Updated 10 months ago
- ☆96Updated 2 years ago
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆207Updated last year
- ☆94Updated last year
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆94Updated 2 years ago
- ☆82Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆65Updated last month
- ☆54Updated last year
- ☆166Updated last year
- ☆66Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆161Updated 3 weeks ago