A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
☆138Apr 28, 2023Updated 3 years ago
Alternatives and similar repositories for ChatGLM-LoRA-RLHF-PyTorch
Users that are interested in ChatGLM-LoRA-RLHF-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- chatglm_rlhf_finetuning☆30Oct 10, 2023Updated 2 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆195May 23, 2023Updated 3 years ago
- A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆60Apr 28, 2023Updated 3 years ago
- A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆220May 20, 2024Updated 2 years ago
- 微调ChatGLM☆128May 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- moss chat finetuning☆51Apr 23, 2024Updated 2 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆241Aug 17, 2025Updated 11 months ago
- AI driven Web Application Firewall☆32Dec 12, 2022Updated 3 years ago
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆34Aug 15, 2023Updated 2 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,717Oct 12, 2023Updated 2 years ago
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆88Aug 16, 2023Updated 2 years ago
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆165Aug 24, 2023Updated 2 years ago
- nlp_interview notes and answers: 该仓库主要记录 NLP 算法工程师相关的面试题和参考答案☆24Nov 16, 2023Updated 2 years ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆118Jun 5, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Humanable Chat Generative-model Fine-tuning | LLM微调☆205Sep 22, 2023Updated 2 years ago
- ChatGLM2-6B 全参数微调，支持多轮对话的高效微调。☆400Aug 17, 2023Updated 2 years ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,429Mar 3, 2024Updated 2 years ago
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆50Jul 8, 2025Updated last year
- ⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SF…☆2,422Sep 29, 2023Updated 2 years ago
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,742Nov 25, 2023Updated 2 years ago
- PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation☆16Mar 28, 2023Updated 3 years ago
- MarketGPT: Developing a Pre-trained transformer (GPT) for Modeling Financial Time Series☆20Sep 5, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed☆11Apr 14, 2023Updated 3 years ago
- self-host ChatGLM-6B API made with fastapi☆78Mar 24, 2023Updated 3 years ago
- chatglm 6b finetuning and alpaca finetuning☆1,526Mar 9, 2025Updated last year
- 本项目用于存放论文：基于远程监督的人物属性抽取研究 的实验数据☆13Oct 30, 2019Updated 6 years ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆107Jul 19, 2023Updated 3 years ago
- Instruction Tuning with GPT-4☆4,334Jun 11, 2023Updated 3 years ago
- ☆23Jun 23, 2023Updated 3 years ago
- Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…☆226Jul 24, 2023Updated 3 years ago
- ChatGLM-6B 指令学习|指令数据|Instruct☆650Apr 10, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementation of Chinese ChatGPT☆285Nov 20, 2023Updated 2 years ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型，使用Two-Step Cognitive Psychology Prompt方法，仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4，ImageBind等图文对话大语言模型，力求以更小的算力和资源实…☆42Jul 17, 2023Updated 3 years ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- NLP model and tech for cyber security tasks☆86Mar 22, 2023Updated 3 years ago
- Official PyTorch implementation of TTS Style Transfer☆25Jun 22, 2022Updated 4 years ago
- deepspeed+trainer简单高效实现多卡微调大模型☆132May 27, 2023Updated 3 years ago
- 中文nlp解决方案(大模型、数据、模型、训练、推理)☆3,833Aug 5, 2025Updated last year