Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
☆6,638Oct 24, 2024Updated last year
Alternatives and similar repositories for Firefly
Users that are interested in Firefly are comparing it to the libraries listed below
Sorting:
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,281Oct 16, 2024Updated last year
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,971Jul 15, 2025Updated 7 months ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆67,659Feb 27, 2026Updated last week
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,681Jul 18, 2024Updated last year
- Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用☆14,746Apr 6, 2025Updated 11 months ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,731Oct 12, 2023Updated 2 years ago
- Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集☆3,055Apr 14, 2024Updated last year
- Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain…☆37,352Nov 10, 2025Updated 3 months ago
- A series of large language models developed by Baichuan Intelligent Technology☆4,117Nov 8, 2024Updated last year
- 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)☆7,165Jul 15, 2025Updated 7 months ago
- MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。☆4,806Feb 10, 2026Updated 3 weeks ago
- Retrieval and Retrieval-augmented LLMs☆11,352Dec 15, 2025Updated 2 months ago
- ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型☆15,652Jun 27, 2024Updated last year
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL,…☆12,820Updated this week
- 整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低 的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。☆22,318May 19, 2025Updated 9 months ago
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆416Oct 21, 2023Updated 2 years ago
- The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.☆20,566Jan 30, 2026Updated last month
- A 13B large language model developed by Baichuan Intelligent Technology☆2,947Sep 6, 2023Updated 2 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,758Nov 25, 2023Updated 2 years ago
- ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型☆41,227Jun 27, 2024Updated last year
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型 ，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等☆2,780Dec 12, 2023Updated 2 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,161Updated this week
- ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型☆13,759Jan 13, 2025Updated last year
- Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。☆4,148Aug 13, 2024Updated last year
- An open-source tool-augmented conversational language model from Fudan University☆12,095Jul 13, 2024Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,426Jun 2, 2025Updated 9 months ago
- Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca☆4,136Apr 18, 2025Updated 10 months ago
- Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).☆7,160Oct 30, 2025Updated 4 months ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,797Dec 12, 2023Updated 2 years ago
- TigerBot: A multi-language multi-task LLM☆2,263Dec 28, 2024Updated last year
- Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合☆5,528Feb 16, 2026Updated 2 weeks ago
- A Next-Generation Training Engine Built for Ultra-Large MoE Models☆5,092Updated this week
- 骆 驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技☆3,618Sep 3, 2023Updated 2 years ago
- 中文nlp解决方案(大模型、数据、模型、训练、推理)☆3,782Aug 5, 2025Updated 7 months ago
- 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）☆23,265Updated this week
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆6,705Feb 27, 2026Updated last week
- ⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SF…☆2,409Sep 29, 2023Updated 2 years ago
- Making large AI models cheaper, faster and more accessible☆41,364Updated this week
- MNBVC(Massive Never-ending BT Vast Chinese corpus)超大 规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志…☆4,128Jan 31, 2026Updated last month