heyblackC / BetterMixture-Top1-Solution
天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案
☆29Updated 9 months ago
Alternatives and similar repositories for BetterMixture-Top1-Solution:
Users that are interested in BetterMixture-Top1-Solution are comparing it to the libraries listed below
- 使用 Qwen2ForSequenceClassification 简单实现文本分类任务。☆59Updated 10 months ago
- ☆108Updated 9 months ago
- 使用单个24G显卡,从0开始训练LLM☆53Updated 6 months ago
- 大语言模型应用:RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆61Updated 2 months ago
- kaggle 2024 Eedi 第10名 金牌方案☆34Updated 3 months ago
- 阿里天池: 2023全球智能汽车AI挑战赛——赛道一:AI大模型检索问答 baseline 80+☆99Updated last year
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆78Updated 5 months ago
- 通义千问的DPO训练☆47Updated 7 months ago
- 通用简单工具项目☆15Updated 6 months ago
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆82Updated last year
- 基于DPO算法微调语言大模型,简单好上手。☆37Updated 9 months ago
- ☆140Updated last year
- 怎么训练一个LLM分词器☆144Updated last year
- 2023全球智能汽车AI挑战赛——赛道一:AI大模型检索问答, 75+ baseline☆57Updated last year
- pytorch分布式训练☆65Updated last year
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆120Updated 5 months ago
- 一套代码指令微调大模型☆39Updated last year
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆32Updated 4 months ago
- ☆107Updated 5 months ago
- LLM+RAG for QA☆21Updated last year
- deepspeed+trainer简单高效实现多卡微调大模型☆124Updated last year
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated 2 months ago
- 本项目用于Embedding模型的相关实验,包括Embedding模型评估、Embedding模型微调、Embedding模型量化等。☆48Updated 9 months ago
- ☆81Updated last year
- ☆67Updated last year
- 对llama3进行全参微调、lora微调以及qlora微调。☆193Updated 6 months ago
- 1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc☆161Updated last year
- baichuan LLM surpervised finetune by lora☆63Updated last year
- qwen models finetuning☆97Updated last month
- ☆12Updated last month