stanford-cs336 / spring2024-lectures
☆204Updated last month
Alternatives and similar repositories for spring2024-lectures:
Users that are interested in spring2024-lectures are comparing it to the libraries listed below
- ☆77Updated 4 months ago
- A brief and partial summary of RLHF algorithms.☆89Updated 2 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Textbook on reinforcement learning from human feedback☆154Updated this week
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆285Updated 2 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆216Updated this week
- Direct Preference Optimization from scratch in PyTorch☆74Updated 11 months ago
- A bibliography and survey of the papers surrounding o1☆1,076Updated 2 months ago
- ☆127Updated 2 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆791Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆670Updated this week
- RLHF implementation details of OAI's 2019 codebase☆171Updated last year
- RewardBench: the first evaluation tool for reward models.☆493Updated this week
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆387Updated 9 months ago
- Building blocks for foundation models.☆440Updated last year
- Notes and commented code for RLHF (PPO)☆55Updated 11 months ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆102Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆233Updated 2 months ago
- LLM-Merging: Building LLMs Efficiently through Merging☆188Updated 4 months ago
- A puzzle to learn about prompting☆123Updated last year
- Reproducible, flexible LLM evaluations☆127Updated last month
- ☆121Updated this week
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆153Updated 9 months ago
- ring-attention experiments☆119Updated 3 months ago
- Scaling Data-Constrained Language Models☆330Updated 4 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆172Updated 5 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆261Updated 2 weeks ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆176Updated 6 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym☆230Updated 2 weeks ago
- A project to improve skills of large language models☆239Updated this week