中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微调, 推理, 测评, 接口)等.
☆220May 17, 2024Updated 2 years ago
Alternatives and similar repositories for LLM-SFT
Users that are interested in LLM-SFT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于大模型ChatGLM，微调方式为LORA，集SFT、RM、PPO算法为一体项目☆14Jun 20, 2023Updated 3 years ago
- 开源SFT数据集整理,随时补充☆585Jun 2, 2023Updated 3 years ago
- Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆6,644Oct 24, 2024Updated 2 years ago
- 从零构建了Agent中最重要的功能-function call☆17Oct 16, 2024Updated 2 years ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆218Oct 6, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆423Jun 25, 2025Updated last year
- 本项目用于大模型数学解题能力方面的数据集合成，模型训练及评测，相关文章记录。☆104Sep 14, 2024Updated 2 years ago
- 基于BERT的文本多标签多分类☆10May 11, 2022Updated 4 years ago
- Code for paper: A Neural Span-Based Continual Named Entity Recognition Model☆18Dec 11, 2023Updated 2 years ago
- macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor☆15Nov 30, 2023Updated 2 years ago
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等☆2,773Dec 12, 2023Updated 2 years ago
- 使用指令微调对大模型进行微调。☆11Jun 28, 2023Updated 3 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,710Oct 12, 2023Updated 3 years ago
- MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。☆5,877Sep 15, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,265Oct 16, 2024Updated 2 years ago
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,922Apr 19, 2026Updated 6 months ago
- 大语言模型指令调优工具（支持 FlashAttention）☆177Jan 4, 2024Updated 2 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- 实验苏神的CoSENT的Torch实现☆33Jan 8, 2022Updated 4 years ago
- NLP/ML面试各类资料链接 汇总（主要Github收集）☆11Mar 3, 2020Updated 6 years ago
- baichuan LLM surpervised finetune by lora☆61Jun 28, 2023Updated 3 years ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,787Dec 12, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 本项目旨在收集开源的表格智能任务数据集（比如表格问答、表格-文本生成等），将原始数据整理为指令微调格式的数据并微调LLM，进而增强LLM对于表格数据的理解，最终构建出专门面向表格智能任务的大型语言模型。☆649Apr 22, 2024Updated 2 years ago
- Tookit-Sihui, a tool of some common algorithm, AI文本混合科学计算器(calculator-sihui), 句子词频-逆文本频率(TF-IDF),搜索BM25, 前缀树搜索关键词(trietree), 模板匹配-递归函数(fu…☆24Apr 9, 2021Updated 5 years ago
- Generate dialog data from documents using LLM like ChatGLM2 or ChatGPT;利用ChatGLM2,ChatGPT等大模型根据文档生成对话数据集☆164Oct 25, 2023Updated 3 years ago
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,647Jul 18, 2024Updated 2 years ago
- ChatGLM2-6B-Explained☆36Jul 28, 2023Updated 3 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,739Nov 25, 2023Updated 2 years ago
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆356Aug 22, 2023Updated 3 years ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆590Jul 11, 2024Updated 2 years ago
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型，涵盖预训练、有监督微调（SFT）和R1推理蒸馏三个阶段。项目采用自定义Transformer架构（包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码），实现高效的长文本处理和…☆24Mar 10, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The code and data for GrammarGPT.☆178Oct 10, 2023Updated 3 years ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 5 years ago
- Is a Openbuddy agent sysprompt. 这是一份Openbuddy智能体的系统提示词☆20Jun 16, 2026Updated 4 months ago
- LLM+RAG for QA☆23Jan 15, 2024Updated 2 years ago
- ☆89Dec 29, 2023Updated 2 years ago
- 整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。☆22,769May 10, 2026Updated 5 months ago
- 中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。☆1,737Apr 20, 2024Updated 2 years ago