linjh1118 / Llama3-Chinese-ORPO
基于Llama3,通过进一步CPT,SFT,ORPO得到的中文版Llama3
☆17Updated 11 months ago
Alternatives and similar repositories for Llama3-Chinese-ORPO:
Users that are interested in Llama3-Chinese-ORPO are comparing it to the libraries listed below
- A simple way to synthesize LLM training data. (under construction⚠)☆16Updated last month
- pre-training llama3 using chinese☆14Updated 10 months ago
- the newest version of llama3,source code explained line by line using Chinese☆22Updated 11 months ago
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated 11 months ago
- Repo for for paper "AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction".☆62Updated 8 months ago
- (撰写ing..)本仓库偏教程性质,以「模型中文化」为一个典型的模型训练问题切入场景,指导读者上手学习LLM二次微调训练。☆32Updated 7 months ago
- ☆37Updated 4 months ago
- 通义千问的DPO训练☆40Updated 6 months ago
- Unleashing the Power of Cognitive Dynamics on Large Language Models☆60Updated 6 months ago
- 基于ChatGLM2-6B进行微调,包括全参数、参数有效性、量化感知训练等,可实现指令微调、多轮对话微调等。☆25Updated last year
- ☆36Updated 6 months ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆30Updated 9 months ago
- LLM RAG 应用,支持 API 调用,语音交互。☆11Updated 9 months ago
- The official Github repository for paper "R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation" (EMNLP 2024 Fin…☆30Updated 3 months ago
- SUS-Chat: Instruction tuning done right☆48Updated last year
- Search, organize, discover anything!☆48Updated 11 months ago
- ☆93Updated 3 months ago
- ☆23Updated 5 months ago
- 根据Qwen2(Qwen1.5)模型生成qwen2 MoE模型的工具☆15Updated 11 months ago
- 中文领域心理健康对话大模型simpsybot☆39Updated 3 months ago
- Awesome papers for role-playing with language models☆174Updated 4 months ago
- LLM+RAG for QA☆22Updated last year
- Imitate OpenAI with Local Models☆88Updated 6 months ago
- The code and data of DPA-RAG☆57Updated 2 months ago
- ☆46Updated last month
- This repo aims to record resource of role-playing abilities in LLMs, including dataset, paper, application, etc.☆107Updated 6 months ago
- Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…☆26Updated 8 months ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆123Updated 2 months ago
- [EMNLP2024] Aligning Large Language Models on Information Extraction☆44Updated 4 months ago
- A Toolkit for Table-based Question Answering☆110Updated last year