taishan1994 / qlora-chinese-LLMView external linksLinks
使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE
☆89Jun 27, 2023Updated 2 years ago
Alternatives and similar repositories for qlora-chinese-LLM
Users that are interested in qlora-chinese-LLM are comparing it to the libraries listed below
Sorting:
- 使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA 高效微调,并做lora model和base model的merge及4bit的量化(quantize)。☆358Aug 22, 2023Updated 2 years ago
- moss chat finetuning☆51Apr 23, 2024Updated last year
- 面向金融领域的小样本跨类迁移事件抽取 第三名 方案及代码☆17Dec 23, 2020Updated 5 years ago
- 基于qlora对baichuan-7B大模型进行指令微调。☆23Jun 22, 2023Updated 2 years ago
- 2021搜狐校园文本匹配算法大赛☆16Jun 4, 2021Updated 4 years ago
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆619Jan 24, 2025Updated last year
- 🌈 NERpy: Implementation of Named Entity Recognition using Python. 命名实体识别工具,支持BertSoftmax、BertSpan等模型,开箱即用。☆117Feb 19, 2024Updated last year
- 中文文本的向量表示方法(Sentence-BERT, CoSENT)的PyTorch简单实现,可以用于文本相似度计算。☆10Mar 27, 2022Updated 3 years ago
- ☆13May 25, 2023Updated 2 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- baseline for MGTV competition 2022 PIR☆11Apr 11, 2022Updated 3 years ago
- A simple implement for multi-label text classification with Bert. I will extend the code to a higher version for very long text over 512,…☆12Jun 2, 2021Updated 4 years ago
- 基于规则匹配的问答系统中的解析器,the parser of based rule QA system☆12Mar 13, 2020Updated 5 years ago
- ☆11May 2, 2023Updated 2 years ago
- KDD 2024 AQA competition 2nd place solution☆12Jul 21, 2024Updated last year
- 大语言模型微调的项目,包含了使用QLora微调ChatGLM和LLama☆28Jun 26, 2023Updated 2 years ago
- 抽取式NLP模型(阅读理解模型,MRC)实现词义消歧(WSD)☆14May 10, 2022Updated 3 years ago
- Hedge fund research team powered by AI agents☆13Feb 16, 2025Updated last year
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆55May 17, 2023Updated 2 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆416Jun 1, 2023Updated 2 years ago
- 采用bert进行事件抽取,[cls]进行事件分类,最后一层向量进行序列标注,两个任务同时训练。☆13Jun 7, 2021Updated 4 years ago
- 中文原生工业测评基准☆15Mar 21, 2024Updated last year
- DataFountain第五届达观杯第4名方案☆11Dec 3, 2021Updated 4 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,730Oct 12, 2023Updated 2 years ago
- 大语言模型指令调优工具(支持 FlashAttention)☆177Jan 4, 2024Updated 2 years ago
- 2022京东全球人工智能技术创新大赛 电商关键属性的图文匹配任务第1名方案☆33Jul 17, 2022Updated 3 years ago
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,686Jul 18, 2024Updated last year
- huggingface ChineseBert Tokenizer☆16Apr 16, 2022Updated 3 years ago
- 本项目采用Keras和ALBERT实现文本多标签分类任务,其中对ALBERT进行微调。☆13Jan 5, 2021Updated 5 years ago
- 中文实体抽取☆14Aug 25, 2018Updated 7 years ago
- softmax, crf, biaffine, globalpointer, efficient globalpointer, ricon☆17Oct 11, 2022Updated 3 years ago
- GTS Engine: A powerful NLU Training System。GTS引擎(GTS-Engine)是一款开箱即用且性能强大的自然语言理解引擎,聚焦于小样本任务,能够仅用小样本就能自动化生产NLP模型。☆93Feb 28, 2023Updated 2 years ago
- Large-scale exact string matching tool☆17Mar 7, 2025Updated 11 months ago
- RDrop 的 torch版☆16Jul 15, 2021Updated 4 years ago
- ☆12Mar 12, 2021Updated 4 years ago
- 基于Bart语言模型的指针生成网络,用于中文语法纠错任务☆16Sep 8, 2022Updated 3 years ago
- An open-source conversational language model developed by the Knowledge Works Research Laboratory at Fudan University.☆64Oct 12, 2023Updated 2 years ago
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆263May 9, 2024Updated last year
- 中文短剧本☆27Apr 17, 2019Updated 6 years ago