☆2,551May 19, 2024Updated last year
Alternatives and similar repositories for weak-to-strong
Users that are interested in weak-to-strong are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Robust recipes to align language models with human and AI preferences☆5,572Apr 8, 2026Updated 2 weeks ago
- ☆4,108Apr 15, 2026Updated last week
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,117Jun 1, 2023Updated 2 years ago
- Train transformer language models with reinforcement learning.☆18,134Updated this week
- Large World Model -- Modeling Text and Video with Millions Context☆7,408Oct 19, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Reference implementation for DPO (Direct Preference Optimization)☆2,883Aug 11, 2024Updated last year
- ☆4,444Jul 31, 2025Updated 8 months ago
- Consistency Distilled Diff VAE☆2,211Nov 7, 2023Updated 2 years ago
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆9,381Updated this week
- Official inference library for Mistral models☆10,773Feb 26, 2026Updated last month
- RewardBench: the first evaluation tool for reward models.☆711Feb 16, 2026Updated 2 months ago
- All things prompt engineering☆5,739Jun 4, 2024Updated last year
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,190Aug 22, 2025Updated 8 months ago
- ☆1,074Mar 6, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Modeling, training, eval, and inference code for OLMo☆6,477Nov 24, 2025Updated 4 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,770Aug 4, 2024Updated last year
- The official implementation of Self-Play Fine-Tuning (SPIN)☆1,239May 8, 2024Updated last year
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,972Aug 9, 2025Updated 8 months ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,219Jul 11, 2024Updated last year
- AllenAI's post-training codebase☆3,696Updated this week
- Scaling Data-Constrained Language Models☆343Jun 28, 2025Updated 9 months ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,286Apr 1, 2026Updated 3 weeks ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,745Jan 8, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A framework for few-shot evaluation of language models.☆12,253Apr 8, 2026Updated 2 weeks ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆20,789Updated this week
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,837Jun 17, 2025Updated 10 months ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,707Aug 12, 2024Updated last year
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆842Jul 1, 2024Updated last year
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,407Apr 11, 2024Updated 2 years ago
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,723Jun 25, 2024Updated last year
- A curated list of reinforcement learning with human feedback resources (continually updated)☆4,348Dec 9, 2025Updated 4 months ago
- Fast and memory-efficient exact attention☆23,457Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A series of large language models trained from scratch by developers @01-ai☆7,830Nov 27, 2024Updated last year
- Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models☆3,156Jan 10, 2025Updated last year
- Tools for merging pretrained large language models.☆6,991Mar 15, 2026Updated last month
- Ongoing research training transformer models at scale☆16,073Updated this week
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆1,001Dec 6, 2024Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,451Jun 2, 2025Updated 10 months ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,227Apr 14, 2026Updated last week