crazycth / WizardLearnerLinks
Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️
☆40Updated last year
Alternatives and similar repositories for WizardLearner
Users that are interested in WizardLearner are comparing it to the libraries listed below
Sorting:
- ☆126Updated last year
- ☆87Updated 5 months ago
- ☆125Updated last year
- ☆68Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆223Updated 6 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆48Updated last year
- ☆42Updated 11 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆94Updated 2 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆283Updated 11 months ago
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆79Updated 11 months ago
- The related works and background techniques about Openai o1☆220Updated last year
- Feeling confused about super alignment? Here is a reading list☆44Updated 2 years ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆145Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- 代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota☆50Updated last year
- a-m-team's exploration in large language modeling☆195Updated 8 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆269Updated last year
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆260Updated last year
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆249Updated 9 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated 2 years ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆255Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆143Updated 2 months ago
- ☆51Updated last year
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆187Updated 7 months ago
- ☆84Updated last year
- Reproducing R1 for Code with Reliable Rewards☆286Updated 9 months ago
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆155Updated last year
- Token level visualization tools for large language models☆92Updated last year
- Official completion of “Training on the Benchmark Is Not All You Need”.☆39Updated last year
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆32Updated last month