Alternatives and similar repositories for following-instructions-human-feedback

Users that are interested in following-instructions-human-feedback are comparing it to the libraries listed below

• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,374Updated 2 years ago
• google-research / FLAN
  ☆1,549Updated 2 months ago
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,791Updated 4 months ago
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆824Updated 2 years ago
• openai / summarize-from-feedback
  Code for "Learning to summarize from human feedback"
  ☆1,050Updated 2 years ago
• allenai / natural-instructions
  Expanding natural instructions
  ☆1,022Updated last year
• IBM / Dromedary
  Dromedary: towards helpful, ethical and reliable LLMs.
  ☆1,143Updated last month
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆1,006Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆696Updated 7 months ago
• openai / automated-interpretability
  ☆1,052Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆537Updated last year
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,363Updated last year
• HazyResearch / ama_prompting
  Ask Me Anything language model prompting
  ☆545Updated 2 years ago
• bigscience-workshop / promptsource
  Toolkit for creating, sharing and using natural language prompts.
  ☆2,960Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆473Updated last year
• lucidrains / toolformer-pytorch
  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
  ☆2,051Updated last year
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆826Updated last year
• google-research / t5x
  ☆2,896Updated last week
• gururise / AlpacaDataCleaned
  Alpaca dataset from Stanford, cleaned and curated
  ☆1,577Updated 2 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆874Updated 2 years ago
• google / BIG-bench
  Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
  ☆3,137Updated last year
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆2,061Updated 2 years ago
• openai / grade-school-math
  ☆1,347Updated last year
• conceptofmind / PaLM
  An open-source implementation of Google's PaLM models
  ☆816Updated last year
• EleutherAI / the-pile
  ☆1,608Updated 2 years ago
• ruixiangcui / AGIEval
  ☆767Updated last year
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,720Updated last year
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆770Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,423Updated last year
• EleutherAI / pythia
  The hub for EleutherAI's work on interpretability and learning dynamics
  ☆2,654Updated 4 months ago