lvwerra / rl-implementationsLinks
This repo contains a set of notebooks to reproduce reinforcement learning algorithms.
☆15Updated 3 years ago
Alternatives and similar repositories for rl-implementations
Users that are interested in rl-implementations are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Updated 3 years ago
- Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"☆34Updated 3 years ago
- Functional local implementations of main model parallelism approaches☆95Updated 2 years ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆216Updated 6 months ago
- Train very large language models in Jax.☆210Updated 2 years ago
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)☆133Updated 3 weeks ago
- Amos optimizer with JEstimator lib.☆82Updated last year
- Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch☆59Updated 4 years ago
- 🎢 Creating and sharing simulation environments for embodied and synthetic data research☆192Updated 2 years ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 3 years ago
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆210Updated 2 years ago
- Evaluation suite for large-scale language models.☆129Updated 4 years ago
- A dataset of alignment research and code to reproduce it☆78Updated 2 years ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 3 years ago
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Unity Machine Learning Agents Toolkit☆48Updated 2 years ago
- A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)☆37Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- Trains Transformer model variants. Data isn't shuffled between batches.☆143Updated 3 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Inference code for LLaMA models in JAX☆120Updated last year
- Submissions for AI and Efficiency SOTA's☆56Updated 5 years ago
- This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."☆46Updated last year
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆171Updated 3 months ago
- Google Research☆46Updated 3 years ago
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago