A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
☆138Apr 28, 2023Updated 3 years ago
Alternatives and similar repositories for ChatGLM-LoRA-RLHF-PyTorch
Users that are interested in ChatGLM-LoRA-RLHF-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆60Apr 28, 2023Updated 3 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆195May 23, 2023Updated 3 years ago
- chatglm_rlhf_finetuning☆30Oct 10, 2023Updated 3 years ago
- A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆219May 20, 2024Updated 2 years ago
- moss chat finetuning☆51Apr 23, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 微调ChatGLM☆128May 5, 2023Updated 3 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,707Oct 12, 2023Updated 3 years ago
- chatglm多gpu用deepspeed和☆409Jul 8, 2024Updated 2 years ago
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆34Aug 15, 2023Updated 3 years ago
- ChatGLM2-6B 全参数微调，支持多轮对话的高效微调。☆400Aug 17, 2023Updated 3 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆238Aug 17, 2025Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆117Jun 5, 2023Updated 3 years ago
- ChatGLM-6B 指令学习|指令数据|Instruct☆650Apr 10, 2023Updated 3 years ago
- Humanable Chat Generative-model Fine-tuning | LLM微调☆203Sep 22, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- nlp_interview notes and answers: 该仓库主要记录 NLP 算法工程师相关的面试题和参考答案☆24Nov 16, 2023Updated 2 years ago
- chatglm 6b finetuning and alpaca finetuning☆1,522Mar 9, 2025Updated last year
- Secrets of RLHF in Large Language Models Part I: PPO☆1,428Mar 3, 2024Updated 2 years ago
- Instruction Tuning with GPT-4☆4,332Jun 11, 2023Updated 3 years ago
- 用户地理位置的聚类算法实现—基于DBSCAN和Kmeans的混合算法☆26Feb 17, 2019Updated 7 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,738Nov 25, 2023Updated 2 years ago
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆50Jul 8, 2025Updated last year
- ⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SF…☆2,427Sep 29, 2023Updated 3 years ago
- Making AI & LLM APPs components reusable, replaceable, portable, and flexible.☆23Apr 28, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等☆2,773Dec 12, 2023Updated 2 years ago
- Evaluation metrics for TTS model.☆12Feb 16, 2025Updated last year
- 为ChatGLM设计的微调数据集生成工具，速来制作自己的猫娘。☆601Feb 25, 2024Updated 2 years ago
- A curated list of reinforcement learning with human feedback resources (continually updated)☆4,439May 20, 2026Updated 5 months ago
- PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation☆16Mar 28, 2023Updated 3 years ago
- Implementation of Chinese ChatGPT☆283Nov 20, 2023Updated 2 years ago
- 用于大模型 RLHF 进行人工数据标注排序的工具。A tool for manual response data annotation sorting in RLHF stage.☆254Aug 1, 2023Updated 3 years ago
- ☆13Sep 20, 2023Updated 3 years ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆105Jul 19, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Unsloth Fine Tuning☆10Jan 12, 2024Updated 2 years ago
- 人工精调的中文对话数据集和一段chatglm的微调代码☆1,191May 3, 2025Updated last year
- 用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]☆21May 16, 2023Updated 3 years ago
- deepspeed+trainer简单高效实现多卡微调大模型☆132May 27, 2023Updated 3 years ago
- 中文nlp解决方案(大模型、数据、模型、训练、推理)☆3,844Aug 5, 2025Updated last year
- A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed☆11Apr 14, 2023Updated 3 years ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,755Jan 8, 2024Updated 2 years ago