seanzhang-zhichen / llama3-chineseLinks
Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。
☆295Updated last year
Alternatives and similar repositories for llama3-chinese
Users that are interested in llama3-chinese are comparing it to the libraries listed below
Sorting:
- ☆349Updated 10 months ago
- Phi3 中文后训练模型仓库☆321Updated 6 months ago
- 中文Mixtral-8x7B（Chinese-Mixtral-8x7B）☆651Updated 9 months ago
- 中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）☆606Updated last year
- Alpaca Chinese Dataset -- 中文指令微调数据集☆205Updated 7 months ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆552Updated 10 months ago
- This is the first Chinese chat model specifically fine-tuned for Chinese through ORPO based on the Meta-Llama-3-8B-Instruct model.☆320Updated last year
- 🚀WebUI integrated platform for latest LLMs | 各大语言模型的全流程工具 WebUI 整合包。支持主流大模型API接口和开源模型。支持知识库，数据库，角色扮演，mj文生图，LoRA和全参数微调，数据集制作，live2d等全流程应用…☆537Updated 6 months ago
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆410Updated last year
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆201Updated last year
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆436Updated last month
- Awesome Chinese LLM: A curated list of Chinese Large Language Model 中文大语言模型数据集和模型资料汇总☆159Updated 11 months ago
- [EMNLP'24] CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models☆464Updated 4 months ago
- ChatGLM2-6B 全参数微调，支持多轮对话的高效微调。☆399Updated last year
- 大模型中文测试题库-民间版本☆83Updated 2 years ago
- Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）☆508Updated last year
- 活字通用大模型☆388Updated 8 months ago
- 从小说中提取对话数据集☆191Updated 11 months ago
- ChatPilot: Chat Agent Web UI，实现Chat对话前端，支持Google搜索、文件网址对话（RAG）、代码解释器功能，复现了Kimi Chat(文件，拖进来；网址，发出来)。☆565Updated 5 months ago
- 360zhinao☆289Updated 3 weeks ago
- chatglm多gpu用deepspeed和☆408Updated 10 months ago
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆360Updated last year
- ☆328Updated 11 months ago
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆441Updated 7 months ago
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆262Updated last year
- 多模态中文LLaMA&Alpaca大语言模型（VisualCLA）☆447Updated last year
- Luotuo Embedding(骆驼嵌入) is a text embedding model, which developed by 李鲁鲁, 冷子昂, 陈启源, 蒟蒻等.☆267Updated last year
- Chinese Community for Google Gemma LLM☆63Updated last year
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ，实现了OpenAI中Chat, Models和Completions接口，包含流式响…☆93Updated last year
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统！可联网做AI搜索☆490Updated 9 months ago