GAIR-NLP / O1-Journey
O1 Replication Journey: A Strategic Progress Report – Part I
☆1,261Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for O1-Journey
- OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models☆991Updated this week
- ☆781Updated 3 weeks ago
- Large Reasoning Models☆492Updated this week
- 📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥☆983Updated this week
- An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention)☆2,539Updated this week
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆704Updated last week
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models☆1,001Updated 9 months ago
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆881Updated 4 months ago
- ☆493Updated 3 weeks ago
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆644Updated last month
- A library for advanced large language model reasoning☆1,420Updated 2 months ago
- ☆873Updated 4 months ago
- [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding☆659Updated 2 months ago
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆938Updated 2 months ago
- ☆1,263Updated this week
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆295Updated 3 weeks ago
- ☆871Updated 3 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆739Updated last week
- Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓☆1,878Updated 2 weeks ago
- MOSS-RLHF☆1,290Updated 8 months ago
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆480Updated last week
- Code for Quiet-STaR☆641Updated 2 months ago
- An Awesome Collection for LLM Survey☆309Updated 2 months ago
- ☆920Updated this week
- Summarize existing representative LLMs text datasets.☆990Updated 2 months ago
- Codebase for Merging Language Models (ICML 2024)☆769Updated 6 months ago
- ✨✨Latest Papers and Benchmarks in Reasoning with Foundation Models☆447Updated 4 months ago
- Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...☆1,559Updated last month
- This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicit…☆635Updated 3 weeks ago
- Awesome-LLM-RAG: a curated list of advanced retrieval augmented generation (RAG) in Large Language Models☆950Updated last month