使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE
☆88Jun 27, 2023Updated 3 years ago
Alternatives and similar repositories for qlora-chinese-LLM
Users that are interested in qlora-chinese-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调,并做lora model和base model的merge及4bit的量化(quantize)。☆356Aug 22, 2023Updated 3 years ago
- 面向金融领域的小样本跨类迁移事件抽取 第三名 方案及代码☆16Dec 23, 2020Updated 5 years ago
- moss chat finetuning☆51Apr 23, 2024Updated 2 years ago
- 基于qlora对baichuan-7B大模型进行指令微调。☆22Jun 22, 2023Updated 3 years ago
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆623Jan 24, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- LORA微调BLOOMZ,参考BELLE☆25Mar 24, 2023Updated 3 years ago
- Source code of ACL 2023 accepted paper "AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression"☆13Jun 14, 2023Updated 3 years ago
- 中文文本的向量表示方法(Sentence-BERT, CoSENT)的PyTorch简单实现,可以用于文本相似度计算。☆10Mar 27, 2022Updated 4 years ago
- 2021搜狐校园文本匹配算法大赛☆16Jun 4, 2021Updated 5 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- ☆11May 2, 2023Updated 3 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,710Oct 12, 2023Updated 3 years ago
- 基于规则匹配的问答系统中的解析器,the parser of based rule QA system☆12Mar 13, 2020Updated 6 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆413Jun 1, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A simple Rasa UI☆14Jul 13, 2020Updated 6 years ago
- chatglm 6b finetuning and alpaca finetuning☆1,522Mar 9, 2025Updated last year
- An open-source conversational language model developed by the Knowledge Works Research Laboratory at Fudan University.☆64Oct 12, 2023Updated 3 years ago
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,647Jul 18, 2024Updated 2 years ago
- 大语言模型指令调优工具(支持 FlashAttention)☆177Jan 4, 2024Updated 2 years ago
- 百亿参数的中英文双语基座大模型☆2,409Jul 7, 2026Updated 3 months ago
- 探索中文instruct数据在ChatGLM, LLaMA上的微调表现☆385Apr 4, 2023Updated 3 years ago
- 本项目采用Keras和ALBERT实现文本多标签分类任务,其中对ALBERT进行微调。☆13Jan 5, 2021Updated 5 years ago
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆55May 17, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 大语言模型微调的项目,包含了使用QLora微调ChatGLM和LLama☆29Jun 26, 2023Updated 3 years ago
- 国内首个全参数训练的法律大模型 HanFei-1.0 (韩非)☆133Oct 28, 2023Updated 3 years ago
- ChatGLM-6B 指令学习|指令数据|Instruct☆650Apr 10, 2023Updated 3 years ago
- LLMs 算法工程师面试资料整理:覆盖基础理论、常见面试问题等。愿这是大家迈向“美好生活”的直通车 🚆,祝每位同学都拿到心仪的 offer!欢迎提交 PR / Issue,一起协作开发与长期维护。☆15Oct 21, 2025Updated last year
- ☆11Dec 1, 2025Updated 11 months ago
- Easy-to-Hard Learning for Information Extraction (ACL 2023 Findings)☆14Jul 11, 2023Updated 3 years ago
- 专注于中文领域大语言模型,落地到某个行业某个领域,成为一个行业大模型、公司级别或行业级别领域大模型。☆126May 19, 2026Updated 5 months ago
- ☆13May 25, 2023Updated 3 years ago
- 用于大模型 RLHF 进行人工数据标注排序的工具。A tool for manual response data annotation sorting in RLHF stage.☆254Aug 1, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Deepspeed、LLM、Medical_Dialogue、医疗大模型、预训练、微调☆318May 3, 2026Updated 5 months ago
- ☆14Aug 26, 2024Updated 2 years ago
- 🌈 NERpy: Implementation of Named Entity Recognition using Python. 命名实体识别工具,支持BertSoftmax、BertSpan等模型,开箱即用。☆118Feb 19, 2024Updated 2 years ago
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆261May 9, 2024Updated 2 years ago
- 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案,LLM-Base+LLM-X+Alpaca,初期,LLM-Base为Chatglm6B底座模型,LLM-X是LLAMA增强模型。该方案简易高效,目标是使此类语言模型能够低能耗广泛部署,并最…☆114Jul 19, 2023Updated 3 years ago
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等☆2,773Dec 12, 2023Updated 2 years ago
- using lear to do ner extraction☆28Mar 13, 2022Updated 4 years ago