google-deepmind / emergent_in_context_learningLinks
☆84Updated 11 months ago
Alternatives and similar repositories for emergent_in_context_learning
Users that are interested in emergent_in_context_learning are comparing it to the libraries listed below
Sorting:
- ☆87Updated last year
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆37Updated 2 years ago
- ☆54Updated 2 years ago
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"☆108Updated last year
- Language modeling via stochastic processes. Oral @ ICLR 2022.☆138Updated 2 years ago
- ☆34Updated last year
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆55Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆108Updated last year
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆98Updated 2 years ago
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆33Updated last month
- [NeurIPS 2023] Learning Transformer Programs☆161Updated last year
- ☆97Updated last year
- The KiloGram Tangrams dataset☆55Updated 2 months ago
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆63Updated 11 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Evaluation pipeline for the BabyLM Challenge 2023.☆76Updated last year
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- ☆45Updated last year
- ☆159Updated 2 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆44Updated last year
- ☆36Updated 3 years ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- ☆31Updated 2 years ago
- ☆74Updated last year
- ☆108Updated 3 years ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆46Updated last year
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆69Updated last year
- Self-Supervised Alignment with Mutual Information☆20Updated last year