StarRing2022 / R1-Nature
最简易的R1结果在小模型上的复现,阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证,对于强推理能力,think思考过程性内容是AGI/ASI的核心。
☆43Updated 2 months ago
Alternatives and similar repositories for R1-Nature:
Users that are interested in R1-Nature are comparing it to the libraries listed below
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- ☆94Updated 4 months ago
- ☆36Updated 7 months ago
- Official implementation for "ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization"☆63Updated last month
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 7 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆68Updated last year
- GLM Series Edge Models☆136Updated 2 months ago
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆44Updated last year
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated 10 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- 我们是第一个完全可商用的角色大模型。☆39Updated 8 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation☆86Updated last month
- Search, organize, discover anything!☆49Updated last year
- SUS-Chat: Instruction tuning done right☆48Updated last year
- ☆19Updated last month
- Deep Reasoning Translation via Reinforcement Learning (arXiv preprint 2025); DRT: Deep Reasoning Translation via Long Chain-of-Thought (a…☆214Updated last week
- Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…☆26Updated 9 months ago
- ☆46Updated 10 months ago
- A light proxy solution for HuggingFace hub.☆46Updated last year
- ☆41Updated 5 months ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆37Updated 7 months ago
- ☆38Updated last month
- Knowledge-Reasoning Synergy Reinforcement Learning.☆34Updated last month
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆57Updated 5 months ago
- ☆73Updated 2 weeks ago
- This is the code repo for our paper "Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts".☆31Updated last month
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆13Updated last month
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆37Updated 11 months ago