Alternatives and similar repositories for rl-implementations

Users that are interested in rl-implementations are comparing it to the libraries listed below

• Sea-Snell / CALM-Dialogue
  Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"
  ☆34Updated 2 years ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆188Updated 3 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆96Updated 2 years ago
• huggingface / ml-agents
  Unity Machine Learning Agents Toolkit
  ☆48Updated 2 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆209Updated 2 years ago
• augustwester / transformer-xl
  A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
  ☆37Updated 2 years ago
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆210Updated 2 years ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆128Updated 4 years ago
• huggingface / simulate
  🎢 Creating and sharing simulation environments for embodied and synthetic data research
  ☆190Updated 2 years ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆82Updated last year
• google-research / cascades
  Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…
  ☆215Updated 4 months ago
• lucidrains / HTM-pytorch
  Implementation of Hierarchical Transformer Memory (HTM) for Pytorch
  ☆75Updated 4 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆87Updated last year
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• EleutherAI / DeeperSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
  ☆169Updated last month
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆119Updated last year
• zphang / minimal-opt
  ☆67Updated 3 years ago
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆130Updated 4 months ago
• CarperAI / Algorithm-Distillation-RLHF
  ☆36Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated last year
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 3 years ago
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆78Updated 2 years ago
• EleutherAI / lm_perplexity
  ☆159Updated 4 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 9 months ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆70Updated 2 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year