openai / ai-and-efficiencyLinks
Submissions for AI and Efficiency SOTA's
☆57Updated 5 years ago
Alternatives and similar repositories for ai-and-efficiency
Users that are interested in ai-and-efficiency are comparing it to the libraries listed below
Sorting:
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- Python Research Framework☆106Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆188Updated 3 years ago
- Train very large language models in Jax.☆209Updated last year
- Neural Turing Machines in pytorch☆48Updated 3 years ago
- Code for the paper, "Distribution Augmentation for Generative Modeling", ICML 2020.☆127Updated 2 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆241Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- ☆40Updated 2 years ago
- JAX implementation ViT-VQGAN☆59Updated 3 years ago
- 🎢 Creating and sharing simulation environments for embodied and synthetic data research☆190Updated last year
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- Source code, datasets and trained models for the paper Learning Advanced Mathematical Computations from Examples (ICLR 2021), by François…☆181Updated 4 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆108Updated last year
- ☆79Updated last week
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 2 months ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆72Updated 3 months ago
- Fast Discounted Cumulative Sums in PyTorch☆96Updated 4 years ago
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆129Updated 3 years ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆211Updated 4 months ago
- 🧀 Pytorch code for the Fromage optimiser.☆129Updated last year
- A centralized place for deep thinking code and experiments☆87Updated 2 years ago
- A Curated Set of Papers Actually Worth Reading☆26Updated 3 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 4 years ago
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago