openai / ai-and-efficiency
Submissions for AI and Efficiency SOTA's
☆54Updated 4 years ago
Related projects: ⓘ
- Learned Hyperparameter Optimizers☆58Updated 3 years ago
- Python Research Framework☆107Updated last year
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆58Updated 2 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆236Updated last year
- Code for the paper, "Distribution Augmentation for Generative Modeling", ICML 2020.☆121Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆57Updated 3 years ago
- ☆64Updated 10 months ago
- Neural Turing Machines in pytorch☆46Updated 2 years ago
- Scaling scaling laws with board games.☆36Updated last year
- A library to create and manage configuration files, especially for machine learning projects.☆77Updated 2 years ago
- ☆156Updated 4 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆184Updated 2 years ago
- ☆149Updated 9 months ago
- Train very large language models in Jax.☆191Updated 10 months ago
- Lightweight interface to AWS☆47Updated 4 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 9 months ago
- ☆76Updated 4 years ago
- ☆27Updated this week
- Image augmentation library for Jax☆36Updated 5 months ago
- Experiment code for the ICLR 2020 paper "RTFM: Generalising to New Environment Dynamics via Reading".☆37Updated 2 years ago
- ☆24Updated 5 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆50Updated 3 years ago
- 👑 Pytorch code for the Nero optimiser.☆20Updated last year
- ☆70Updated last week
- 🎢 Creating and sharing simulation environments for embodied and synthetic data research☆187Updated 11 months ago
- 🧀 Pytorch code for the Fromage optimiser.☆120Updated 2 months ago
- See the issue board for the current status of active and prospective projects!☆65Updated 2 years ago
- JAX implementation ViT-VQGAN☆54Updated 2 years ago
- Framework-agnostic library for checking array/tensor shapes at runtime.☆47Updated 3 years ago