chaoyi-wu / Finetune_LLAMALinks
简单易懂的LLaMA微调指南。
☆410Updated 2 years ago
Alternatives and similar repositories for Finetune_LLAMA
Users that are interested in Finetune_LLAMA are comparing it to the libraries listed below
Sorting:
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆619Updated 10 months ago
- llama2 finetuning with deepspeed and lora☆175Updated 2 years ago
- 活字通用大模 型☆391Updated last year
- A Chinese medical ChatGPT based on LLaMa, training from large-scale pretrain corpus and multi-turn dialogue dataset.☆383Updated last year
- Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.☆1,018Updated last year
- Deepspeed、LLM、Medical_Dialogue、医疗大模型、预训练、微调☆286Updated last year
- PromptCBLUE: a large-scale instruction-tuning dataset for multi-task and few-shot learning in the medical domain in Chinese☆382Updated last year
- personal chatgpt☆391Updated 11 months ago
- 对llama3进行全参微调、lora微调以及qlora微调。☆210Updated last year
- 开源SFT数据集整理,随时补充☆559Updated 2 years ago
- CMB, A Comprehensive Medical Benchmark in Chinese☆216Updated 8 months ago
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆354Updated last year
- 🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调,我们的眼光不止于医疗问答☆336Updated 2 years ago
- The Largest-scale Chinese Medical QA Dataset: with 26,000,000 question answer pairs.☆301Updated last year
- Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆414Updated 2 years ago
- an intro to retrieval augmented large language model☆304Updated 2 years ago
- Paper List for In-context Learning 🌷☆188Updated last year
- 大模型多维度中文对齐评测基准 (ACL 2024)☆422Updated last month
- 多模态中文LLaMA&Alpaca大语言模型(VisualCLA)☆458Updated 2 years ago
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆213Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆408Updated 5 months ago
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆264Updated 2 years ago
- ☆532Updated last year
- GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.☆696Updated 10 months ago
- 该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记(多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT)☆368Updated last year
- 使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调,并做lora model和base model的merge及4bit的量化(quantize)。☆356Updated 2 years ago
- ☆80Updated 6 months ago
- 基于ChatGPT构建的中文self-instruct数据集☆119Updated 2 years ago
- 一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测,低参数量及 全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。☆220Updated last year
- YuLan: An Open-Source Large Language Model☆635Updated 10 months ago