XU-YIJIE / hobo-llm-from-scratchLinks
From Llama to Deepseek, grpo/mtp implemented. With pt/sft/lora/qlora included
☆27Updated last month
Alternatives and similar repositories for hobo-llm-from-scratch
Users that are interested in hobo-llm-from-scratch are comparing it to the libraries listed below
Sorting:
- Train your grpo with zero dataset and low resources, 8bit/4bit/lora/qlora supported, multi-gpu supported ...☆71Updated last month
- ☆63Updated 6 months ago
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆62Updated 3 months ago
- ☆18Updated last month
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated 3 months ago
- ☆84Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- 使用单个24G显卡,从0开始训练LLM☆54Updated last week
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆45Updated 7 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆82Updated 2 months ago
- LeetCode Training and Evaluation Dataset☆24Updated last month
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆100Updated last week
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆79Updated 6 months ago
- The related works and background techniques about Openai o1☆221Updated 4 months ago
- The GPU RAM Estimator provides a simple tool for estimating GPU memory usage during training and inference.☆34Updated last year
- ☆123Updated last year
- Collection of papers for scalable automated alignment.☆90Updated 7 months ago
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆25Updated last year
- 怎么训练一个LLM分词器☆149Updated last year
- ☆141Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆115Updated 2 years ago
- ☆108Updated 6 months ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆41Updated 2 weeks ago
- ☆34Updated 5 months ago
- ☆71Updated last week
- NTK scaled version of ALiBi position encoding in Transformer.☆68Updated last year
- Counting-Stars (★)☆83Updated this week
- A Comprehensive Survey on Long Context Language Modeling☆147Updated 2 weeks ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆203Updated 3 months ago
- ☆33Updated 8 months ago