yuanzhoulvpi2017 / nano_rlLinks
在verl上做reward的定制开发
☆70Updated last month
Alternatives and similar repositories for nano_rl
Users that are interested in nano_rl are comparing it to the libraries listed below
Sorting:
- ☆47Updated 5 months ago
- ☆142Updated last year
- ☆84Updated last year
- llm & rl☆156Updated this week
- a-m-team's exploration in large language modeling☆173Updated last month
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆64Updated 4 months ago
- ☆111Updated last year
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆145Updated 6 months ago
- 基于DPO算法微调语言大模型,简单好上手。☆40Updated last year
- The related works and background techniques about Openai o1☆223Updated 6 months ago
- A live reading list for LLM-synthetic-data.☆307Updated last week
- ☆266Updated last month
- ☆28Updated last year
- 怎么训练一个LLM分词器☆151Updated 2 years ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆378Updated 2 weeks ago
- This is a repo consisting of papers about LLMs' perception of their knowledge boundaries☆13Updated 2 months ago
- ☆41Updated 10 months ago
- A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)☆44Updated last month
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆91Updated 10 months ago
- Awesome Agent Training☆179Updated last week
- Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"☆128Updated 2 weeks ago
- A research repo for experiments about Reinforcement Finetuning☆49Updated 3 months ago
- Fantastic Data Engineering for Large Language Models☆89Updated 6 months ago
- ☆141Updated 10 months ago
- ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation☆35Updated 3 weeks ago
- [SIGIR'24] The official implementation code of MOELoRA.☆169Updated 11 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆353Updated last year
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆86Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆124Updated 8 months ago
- The official implementation of ACL'24 paper: Synergistic Interplay between Search and Large Language Models for Information Retrieval.☆35Updated last year