LC1332 / CamelBell-Chinese-LoRA
CamelBell（驼铃) is be a Chinese Language Tuning project based on LoRA. CamelBell is belongs to Project Luotuo(骆驼), an open sourced Chinese-LLM project created by 冷子昂 @ 商汤科技 & 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技
☆172Updated last year
Alternatives and similar repositories for CamelBell-Chinese-LoRA:
Users that are interested in CamelBell-Chinese-LoRA are comparing it to the libraries listed below
- 探索中文instruct数据在ChatGLM, LLaMA上的微调表现☆390Updated last year
- alpaca中文指令微调数据集☆392Updated last year
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆164Updated last year
- ChatGLM-6B fine-tuning.☆135Updated last year
- Luotuo Embedding(骆驼嵌入) is a text embedding model, which developed by 李鲁鲁, 冷子昂, 陈启源, 蒟蒻等.☆264Updated last year
- Kanchil（鼷鹿）是世界上最小的偶蹄目动物，这个开源项目意在探索小模型（6B以下）是否也能具备和人类偏好对齐的能力。☆113Updated last year
- Humanable Chat Generative-model Fine-tuning | LLM微调☆207Updated last year
- ChatGLM-6B 指令学习|指令数据|Instruct☆655Updated last year
- 骆驼QA，中文大语言阅读理解模型。☆75Updated last year
- deep learning☆150Updated 2 weeks ago
- 基于sentence transformers和chatglm实现的文档搜索工具☆154Updated last year
- 语言模型中文认知能力分析☆235Updated last year
- pCLUE: 1000000+多任务提示学习数据集☆485Updated 2 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆420Updated last year
- ☆306Updated last year
- Simple implementation of using lora form the peft library to fine-tune the chatglm-6b☆85Updated last year
- ☆172Updated last year
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆106Updated last year
- 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最…☆117Updated last year
- ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。☆126Updated last year
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆192Updated last year
- Chinese large language model base generated through incremental pre-training on Chinese datasets☆235Updated last year
- 微调ChatGLM☆125Updated last year
- Llama2开源模型中文版-全方位测评，基于SuperCLUE的OPEN基准 | Llama2 Chinese evaluation with SuperCLUE☆126Updated last year
- Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)☆722Updated last year
- llama inference for tencentpretrain☆98Updated last year
- A Chinese Open-Domain Dialogue System☆319Updated last year
- Implementation of Chinese ChatGPT☆287Updated last year
- 多显卡部署版 | ChatGLM-6B：开源双语对话语言模型 | An Open Bilingual Dialogue Language Model☆62Updated last year
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆358Updated last year