linjh1118 / Llama3-Chinese-ORPOLinks
基于Llama3，通过进一步CPT，SFT，ORPO得到的中文版Llama3
☆17Updated last year
Alternatives and similar repositories for Llama3-Chinese-ORPO
Users that are interested in Llama3-Chinese-ORPO are comparing it to the libraries listed below
Sorting:
- pre-training llama3 using chinese☆13Updated last year
- Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…☆27Updated last year
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- the newest version of llama3，source code explained line by line using Chinese☆22Updated last year
- 最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。☆44Updated 7 months ago
- ☆16Updated last year
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆135Updated 8 months ago
- Collection of model-centric MCP servers☆23Updated 4 months ago
- （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。☆35Updated last year
- A fluent, scalable, and easy-to-use LLM data processing framework.☆26Updated last month
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆59Updated 3 months ago
- ☆95Updated 9 months ago
- 一起来养一只拥有专属记忆的AI猫猫吧！☆10Updated 10 months ago
- 集成Qwen与DeepSeek等先进大语言模型，支持纯LLM+分类层模式及LLM+LoRA+分类层模式，使用transformers模块化设计和训练便于根据需要调整或替换组件。☆14Updated 2 weeks ago
- [IJCAI 2024] CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning☆24Updated last year
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- 天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案☆32Updated last year
- SUS-Chat: Instruction tuning done right☆49Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆212Updated last month
- GLM Series Edge Models☆149Updated 3 months ago
- 根据Qwen2（Qwen1.5）模型生成qwen2 MoE模型的工具☆16Updated last year
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking☆39Updated 8 months ago
- Just for debug☆56Updated last year
- 基于ChatGLM2-6B进行微调，包括全参数、参数有效性、量化感知训练等，可实现指令微调、多轮对话微调等。☆26Updated 2 years ago
- ☆292Updated 3 months ago
- 收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality☆15Updated 9 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆54Updated this week
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆15Updated last year
- ☆42Updated 4 months ago
- ☆22Updated 5 months ago