seanzhang-zhichen / llama3-chinese
Llama3-Chinese是以Meta-Llama-3-8B为底座,使用 DORA + LORA+ 的训练方法,在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。
☆294Updated last year
Alternatives and similar repositories for llama3-chinese:
Users that are interested in llama3-chinese are comparing it to the libraries listed below
- ☆348Updated 8 months ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆548Updated 9 months ago
- 中文Mixtral混合专家大模型(Chinese Mixtral MoE LLMs)☆604Updated 11 months ago
- Phi3 中文后训练模型仓库☆321Updated 4 months ago
- 中文Mixtral-8x7B(Chinese-Mixtral-8x7B)☆650Updated 8 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆195Updated 6 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆424Updated 3 weeks ago
- 从小说中提取对话数据集☆179Updated 10 months ago
- 多模态中文LLaMA&Alpaca大语言模型(VisualCLA)☆445Updated last year
- 通义千问VLLM推理部署DEMO☆569Updated last year
- 360zhinao☆289Updated 3 months ago
- Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆410Updated last year
- [EMNLP'24] CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models☆459Updated 3 months ago
- Llama3-Tutorial(XTuner、LMDeploy、OpenCompass)☆507Updated 11 months ago
- Baichuan2代码的逐行解析版本,适合小白☆213Updated last year
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆195Updated 11 months ago
- This is the first Chinese chat model specifically fine-tuned for Chinese through ORPO based on the Meta-Llama-3-8B-Instruct model.☆320Updated 11 months ago
- 🚀WebUI integrated platform for latest LLMs | 各大语言模型的全流程工具 WebUI 整合包。支持主流大模型API接口和开源模型。支持知识库,数据库,角色扮演,mj文生图,LoRA和全参数微调,数据集制作,live2d等全流程应用…☆533Updated 5 months ago
- 活字通用大模型☆387Updated 7 months ago
- ☆322Updated 10 months ago
- chatglm3base模型的有监督微调SFT☆74Updated last year
- 🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调,我们的眼光不止于医疗问答☆322Updated last year
- ChatPilot: Chat Agent Web UI,实现Chat对话前端,支持Google搜索、文件网址对话(RAG)、代码解释器功能,复现了Kimi Chat(文件,拖进来;网址,发出来)。☆558Updated 3 months ago
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆442Updated 6 months ago
- CMMLU: Measuring massive multitask language understanding in Chinese☆754Updated 4 months ago
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆477Updated 7 months ago
- Q&A based on elasticsearch+langchain+chatglm2 | 基于elasticsearch,langchain,chatglm2的自有知识库问答☆241Updated last year
- OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型,由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。☆258Updated last year
- 🌞 CareGPT (关怀GPT)是一个医疗大语言模型,同时它集合了数十个公开可用的医疗微调数据集和开放可用的医疗大语言模型,包含LLM的训练、测评、部署等以促进医疗LLM快速发展。Medical LLM, Open Source Driven for a Healthy…☆873Updated 11 months ago
- Chat-甄嬛是利用《甄嬛传》剧本中所有关于甄嬛的台词和语句,基于ChatGLM2进行LoRA微调得到的模仿甄嬛语气的聊天语言模型。☆657Updated 7 months ago