yongzhuo / gemma-sft
Gemma-SFT, gemma-2b/gemma-7b微调(finetune,transformers)/LORA(peft)/推理(inference)
☆29Updated 10 months ago
Alternatives and similar repositories for gemma-sft:
Users that are interested in gemma-sft are comparing it to the libraries listed below
- 大语言模型训练和服务调研☆37Updated last year
- 大语言模型微调的项目,包含了使用QLora微调ChatGLM和LLama☆27Updated last year
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆54Updated last year
- ☆135Updated 10 months ago
- 用于微调LLM的中文指令数据集☆27Updated last year
- GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models☆19Updated last year
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆55Updated 10 months ago
- 基于ChatGLM2-6B进行微调,包括全参数、参数有效性、量化感知训练等,可实现指令微调、多轮对话微调等。☆25Updated last year
- 通义千问的DPO训练☆40Updated 6 months ago
- the newest version of llama3,source code explained line by line using Chinese☆22Updated 11 months ago
- Imitate OpenAI with Local Models☆88Updated 6 months ago
- Ziya-LLaMA-13B是IDEA基于LLaMa的130亿参数的大规模预训练模型,具备翻译,编程,文本分类,信息抽取,摘要,文案生成,常识问答和数学计算等能力。目前姜子牙通用大模型已完成大规模预训练、多任务有监督微调和人类反馈学习三阶段的训练过程。本文主要用于Ziya-…☆45Updated last year
- 使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆85Updated last year
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆44Updated 11 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆51Updated 2 months ago
- ☆66Updated last year
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 7 months ago
- 千问14B和7B的逐行解释☆57Updated last year
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆90Updated last year
- (撰写ing..)本仓库偏教程性质,以「模型中文化」为一个典型的模型训练问题切入场景,指导读者上手学习LLM二次微调训练。☆32Updated 7 months ago
- make LLM easier to use☆59Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated 11 months ago
- qwen models finetuning☆93Updated 2 weeks ago
- Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on☆97Updated 11 months ago
- 通用简单工具项目☆17Updated 5 months ago
- Qwen-Efficient-Tuning☆43Updated last year
- ☆16Updated last year
- 大型语言模型实战指南:应用实践与场景落地☆67Updated 6 months ago
- 大语言模型应用:RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模 型、微调训练、强化学习、天池数据竞赛☆58Updated last month
- Here is a demo for PDF parser (Including OCR, object detection tools)☆34Updated 5 months ago