crazycth / WizardLearnerLinks
Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️
☆35Updated last year
Alternatives and similar repositories for WizardLearner
Users that are interested in WizardLearner are comparing it to the libraries listed below
Sorting:
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆62Updated 3 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆82Updated 2 months ago
- ☆63Updated 6 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- ☆112Updated this week
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆100Updated last week
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆50Updated 2 months ago
- Feeling confused about super alignment? Here is a reading list☆42Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆61Updated 5 months ago
- ☆18Updated last month
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated last year
- ☆104Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆203Updated 3 months ago
- ☆108Updated 6 months ago
- A research repo for experiments about Reinforcement Finetuning☆47Updated last month
- On Memorization of Large Language Models in Logical Reasoning☆65Updated 2 months ago
- Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆73Updated last month
- 使用单个24G显卡,从0开始训练LLM☆54Updated last week
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 11 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆27Updated last week
- ☆32Updated 2 weeks ago
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆128Updated 11 months ago
- ☆48Updated 3 weeks ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆120Updated 7 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆32Updated this week
- ☆81Updated last year
- Official completion of “Training on the Benchmark Is Not All You Need”.☆32Updated 5 months ago
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆39Updated 10 months ago