openai / summarize-from-feedback

Related projects ⓘ

Alternatives and complementary repositories for summarize-from-feedback

• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,225Updated last year
• allenai / natural-instructions
  Expanding natural instructions
  ☆956Updated 10 months ago
• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,211Updated 8 months ago
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆821Updated 2 years ago
• microsoft / ProphetNet
  A research project for natural language generation, containing the official implementations by MSRA NLC team.
  ☆690Updated 3 months ago
• voidful / TextRL
  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…
  ☆542Updated 6 months ago
• google-research / FLAN
  ☆1,474Updated 2 weeks ago
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆457Updated 2 years ago
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,609Updated last year
• tonyzhaozh / few-shot-learning
  Few-shot Learning of GPT-3
  ☆342Updated last year
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆851Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,335Updated 7 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆971Updated last year
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆980Updated 3 months ago
• uber-research / PPLM
  Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
  ☆1,131Updated 8 months ago
• facebookresearch / FiD
  Fusion-in-Decoder
  ☆550Updated last year
• google-research / prompt-tuning
  Original Implementation of Prompt Tuning from Lester, et al, 2021
  ☆653Updated 5 months ago
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆779Updated 4 months ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆466Updated 8 months ago
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆692Updated last year
• openai / following-instructions-human-feedback
  ☆1,178Updated last year
• facebookresearch / contriever
  Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning
  ☆680Updated last year
• hendrycks / math
  The MATH Dataset (NeurIPS 2021)
  ☆884Updated 3 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆754Updated last year
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆506Updated last year
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆894Updated 6 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,500Updated 10 months ago
• facebookresearch / KILT
  Library for Knowledge Intensive Language Tasks
  ☆915Updated 2 years ago
• google-deepmind / pg19
  ☆229Updated 4 years ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆797Updated last year