☆98May 30, 2023Updated 3 years ago
Alternatives and similar repositories for reward-modeling
Users that are interested in reward-modeling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repository for transformer critique learning and generation☆88Dec 7, 2023Updated 2 years ago
- A (somewhat) minimal library for finetuning language models with PPO on human feedback.☆91Nov 23, 2022Updated 3 years ago
- [NIPS2023] RRHF & Wombat☆805Sep 22, 2023Updated 2 years ago
- Experiments with generating opensource language model assistants☆97May 14, 2023Updated 3 years ago
- A library for squeakily cleaning and filtering language datasets.☆50Jul 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Aug 15, 2024Updated last year
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,752Jan 8, 2024Updated 2 years ago
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆10May 5, 2024Updated 2 years ago
- Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…☆564Apr 23, 2026Updated 3 months ago
- ☆33Apr 23, 2023Updated 3 years ago
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆34Aug 15, 2023Updated 2 years ago
- A modular RL library to fine-tune language models to human preferences☆2,393Mar 1, 2024Updated 2 years ago
- ☆157Mar 18, 2023Updated 3 years ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆183Feb 13, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆19Jan 11, 2024Updated 2 years ago
- A reimplementation of KOSMOS-1 from "Language Is Not All You Need: Aligning Perception with Language Models"☆27Mar 3, 2023Updated 3 years ago
- Here we collect trick questions and failed tasks for open source LLMs to improve them.☆32Apr 20, 2023Updated 3 years ago
- Suri: Multi-constraint instruction following for long-form text generation [EMNLP’24]☆27Oct 3, 2025Updated 9 months ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,426Mar 3, 2024Updated 2 years ago
- ☆12Jan 17, 2025Updated last year
- Code for the paper Fine-Tuning Language Models from Human Preferences☆1,393Jul 25, 2023Updated 3 years ago
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 5 years ago
- One stop shop for all things carp☆58Sep 9, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Nov 8, 2022Updated 3 years ago
- Simple next-token-prediction for RLHF☆228Sep 30, 2023Updated 2 years ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,853Jun 17, 2025Updated last year
- Open source implementation of InstructGPT (not finished)☆31Apr 13, 2023Updated 3 years ago
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆213Jul 31, 2023Updated 2 years ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆41Jun 16, 2024Updated 2 years ago
- Pytorch implementation on OpenAI's Procgen ppo-baseline, built from scratch.☆14May 17, 2024Updated 2 years ago
- Pretraining summarization models using a corpus of nonsense☆13Sep 28, 2021Updated 4 years ago
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- Self-Alignment with Principle-Following Reward Models☆170Sep 18, 2025Updated 10 months ago
- Chain-of-thought 방식을 활용하여 llama2를 fine-tuning☆10Nov 18, 2023Updated 2 years ago
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"☆39Jan 12, 2024Updated 2 years ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆172Apr 7, 2023Updated 3 years ago
- A Data Source for Reasoning Embodied Agents☆20Sep 18, 2023Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago