crazycth / WizardLearnerLinks
Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️
☆36Updated last year
Alternatives and similar repositories for WizardLearner
Users that are interested in WizardLearner are comparing it to the libraries listed below
Sorting:
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆57Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆113Updated 2 months ago
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆64Updated 4 months ago
- A research repo for experiments about Reinforcement Finetuning☆48Updated 2 months ago
- ☆63Updated 6 months ago
- ☆109Updated 7 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆127Updated this week
- ☆105Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆50Updated 2 months ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated last year
- ☆53Updated last week
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆189Updated 3 weeks ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆133Updated last year
- 使用单个24G显卡,从0开始训练LLM☆55Updated last month
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆33Updated 3 weeks ago
- ☆18Updated 2 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆122Updated 7 months ago
- ☆33Updated 2 weeks ago
- a-m-team's exploration in large language modeling☆160Updated 3 weeks ago
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆39Updated 11 months ago
- The related works and background techniques about Openai o1☆222Updated 5 months ago
- ☆36Updated 9 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆30Updated 3 weeks ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆84Updated 3 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆213Updated 4 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆154Updated last year
- ☆203Updated 4 months ago
- ☆81Updated last year