mlzoo / BaoZaoAI
基于Qwen-2.5-1.5B 进行DPO fine-tuning后,意外说真话的AI暴躁哥
☆43Updated 3 months ago
Alternatives and similar repositories for BaoZaoAI:
Users that are interested in BaoZaoAI are comparing it to the libraries listed below
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆159Updated last year
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆59Updated 8 months ago
- 使用单个24G显卡,从0开始训练LLM☆53Updated 6 months ago
- LLM101n: Let's build a Storyteller 中文版☆131Updated 8 months ago
- 一些 LLM 方面的从零复现笔记☆185Updated last week
- ☆226Updated 11 months ago
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆57Updated 11 months ago
- 通义千问的DPO训练☆47Updated 7 months ago
- 人工智能培训课件资源☆83Updated this week
- ☆104Updated last year
- 怎么训练一个LLM分词器☆144Updated last year
- 从0开始,将chatgpt的技术路线跑一遍。☆230Updated 7 months ago
- ☆140Updated 11 months ago
- A Multi-modal RAG Project with Dataset from Honor of Kings, one of the most popular smart phone games in China☆66Updated 7 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 9 months ago
- qwen models finetuning☆97Updated last month
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆316Updated 9 months ago
- large language model training-3-stages+deployment☆47Updated last year
- ☆108Updated 9 months ago
- A repo for update and debug Mixtral-7x8B、MOE、ChatGLM3、LLaMa2、 BaChuan、Qwen an other LLM models include new models mixtral, mixtral 8x7b, …☆43Updated last month
- MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval☆155Updated last week
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆54Updated 7 months ago
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆196Updated 11 months ago
- ☆107Updated 5 months ago
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆83Updated 7 months ago
- llama,chatglm 等 模型的微调☆88Updated 9 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆424Updated 3 weeks ago
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆28Updated 11 months ago
- 「PyTorch」A deep matching model library for recommendations & advertising. It's easy to train models and to export representation vectors …☆85Updated 2 years ago
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆418Updated last month