中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微调, 推理, 测评, 接口)等.
☆218May 17, 2024Updated 2 years ago
Alternatives and similar repositories for LLM-SFT
Users that are interested in LLM-SFT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于大模型ChatGLM,微调方式为LORA,集SFT、RM、PPO算法为一体项目☆14Jun 20, 2023Updated 3 years ago
- 开源SFT数据集整理,随时补充☆586Jun 2, 2023Updated 3 years ago
- Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆6,642Oct 24, 2024Updated 2 years ago
- 从零构建了Agent中最重要的功能-function call☆17Oct 16, 2024Updated 2 years ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆423Jun 25, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Alpaca Chinese Dataset -- 中文指令微调数据集☆219Oct 6, 2024Updated 2 years ago
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等☆2,774Dec 12, 2023Updated 2 years ago
- MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。☆5,901Sep 15, 2026Updated 2 months ago
- macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor☆15Nov 30, 2023Updated 2 years ago
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆104Sep 14, 2024Updated 2 years ago
- 使用指令微调对大模型进行微调。☆11Jun 28, 2023Updated 3 years ago
- BELLE: Be Everyone's Large Language model Engine(开源中文对话大模型)☆8,258Oct 16, 2024Updated 2 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,706Oct 12, 2023Updated 3 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 大语言模型指令调优工具(支持 FlashAttention)☆177Jan 4, 2024Updated 2 years ago
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,915Apr 19, 2026Updated 7 months ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- baichuan LLM surpervised finetune by lora☆61Jun 28, 2023Updated 3 years ago
- Tookit-Sihui, a tool of some common algorithm, AI文本混合科学计算器(calculator-sihui), 句子词频-逆文本频率(TF-IDF),搜索BM25, 前缀树搜索关键词(trietree), 模板匹配-递归函数(fu…☆24Apr 9, 2021Updated 5 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,785Dec 12, 2023Updated 2 years ago
- 本项目旨在收集开源的表格智能任务数据集(比如表格问答、表格-文本生成等),将原始数据整理为指令微调格式的数据并微调LLM,进而增强LLM对于表格数据的理解,最终构建出专门面向表格智能任务的大型语言模型。☆648Apr 22, 2024Updated 2 years ago
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,645Jul 18, 2024Updated 2 years ago
- ChatGLM2-6B-Explained☆36Jul 28, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 实验苏神的CoSENT的Torch实现☆33Jan 8, 2022Updated 4 years ago
- Generate dialog data from documents using LLM like ChatGLM2 or ChatGPT;利用ChatGLM2,ChatGPT等大模型根据文档生成对话数据集☆164Oct 25, 2023Updated 3 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,736Nov 25, 2023Updated 2 years ago
- 使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调,并做lora model和base model的merge及4bit的量化(quantize)。☆357Aug 22, 2023Updated 3 years ago
- Graphical User Interface for aclpubcheck☆11Jan 8, 2025Updated last year
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型,涵盖预训练、有监督微调(SFT)和R1推理蒸馏三个阶段。项目采用自定义Transformer架构(包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码),实现高效的长文本处理和…☆24Mar 10, 2025Updated last year
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 5 years ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆589Jul 11, 2024Updated 2 years ago
- The code and data for GrammarGPT.☆178Oct 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- NLP/ML面试各类资料链接 汇总(主要Github收集)☆11Mar 3, 2020Updated 6 years ago
- 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)☆25,296Oct 14, 2026Updated last month
- 整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。☆22,786May 10, 2026Updated 6 months ago
- LLM+RAG for QA☆23Jan 15, 2024Updated 2 years ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆76,105Updated this week
- Code for "SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition", accepted at COLING 2022.☆12Nov 25, 2022Updated 3 years ago
- ☆89Dec 29, 2023Updated 2 years ago
Are these results useful?