openai / ai-and-efficiency
Submissions for AI and Efficiency SOTA's
☆56Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for ai-and-efficiency
- Learned Hyperparameter Optimizers☆58Updated 3 years ago
- Scaling scaling laws with board games.☆43Updated last year
- Code for the paper "Understanding RL Vision"☆43Updated last year
- Python Research Framework☆107Updated 2 years ago
- Code for the paper, "Distribution Augmentation for Generative Modeling", ICML 2020.☆121Updated last year
- A library to create and manage configuration files, especially for machine learning projects.☆77Updated 2 years ago
- Train very large language models in Jax.☆195Updated last year
- ☆44Updated last month
- Read Google Cloud Storage, Azure Blobs, and local paths with the same interface☆58Updated 2 months ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆237Updated last year
- ☆24Updated 5 years ago
- A simple library for scaling up JAX programs☆127Updated 3 weeks ago
- Jiminy Cricket Environment (NeurIPS 2021)☆24Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 2 years ago
- Interpretability dashboard for reinforcement learners☆16Updated 5 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆59Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆69Updated last year
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆58Updated 3 years ago
- ☆18Updated last year
- Measuring the situational awareness of language models☆33Updated 9 months ago
- Code for minimum-entropy coupling.☆30Updated 4 months ago
- Reward Learning by Simulating the Past☆43Updated 5 years ago
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆44Updated 3 years ago
- Experiment code for the ICLR 2020 paper "RTFM: Generalising to New Environment Dynamics via Reading".☆38Updated 3 years ago
- Redwood Research's transformer interpretability tools☆12Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆77Updated 2 years ago
- See the issue board for the current status of active and prospective projects!☆65Updated 2 years ago