A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
☆60Apr 28, 2023Updated 3 years ago
Alternatives and similar repositories for Alpaca-LoRA-RLHF-PyTorch
Users that are interested in Alpaca-LoRA-RLHF-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆219May 20, 2024Updated 2 years ago
- Latex template for CUHK PhD Thesis☆14Jun 29, 2025Updated last year
- 用户地理位置的聚类算法实现—基于DBSCAN和Kmeans的混合算法☆26Feb 17, 2019Updated 7 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆238Aug 17, 2025Updated last year
- [EMNLP 2021] PyTorch Implementation of Contrastive Domain Adaptation for Question Answering using Limited Text Corpora☆14Jul 4, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Vietnamese GPT-J API service deployed with Docker & Helm chart☆10Dec 11, 2022Updated 3 years ago
- 大型中文道德句数据集CMOS☆11Apr 11, 2022Updated 4 years ago
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆844Jul 1, 2024Updated 2 years ago
- please smile☆11Jun 4, 2019Updated 7 years ago
- ☆12Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.☆11May 26, 2023Updated 3 years ago
- Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)☆33Jun 6, 2022Updated 4 years ago
- This is the repo for our work “An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation” (ACL 2023).☆14Jul 23, 2023Updated 3 years ago
- Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"☆14Sep 19, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- openai-tutorial☆14Mar 5, 2023Updated 3 years ago
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆55Jun 3, 2024Updated 2 years ago
- ☆14Apr 8, 2023Updated 3 years ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel☆24Apr 3, 2023Updated 3 years ago
- [Paperlist] Awesome paper list of controllable text generation via latent auto-encoders. Contributions of any kind are welcome.☆51Dec 23, 2022Updated 3 years ago
- Benchmarks for the VNN Comp 2022☆10Jun 7, 2024Updated 2 years ago
- ☆17Oct 5, 2022Updated 4 years ago
- Explains Canadian Bills☆17May 13, 2023Updated 3 years ago
- 4 bits quantization of LLaMa using GPTQ☆12Jun 2, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repo is the official implementation of the ICLR'23 paper "Towards Robustness Certification Against Universal Perturbations." We calc…☆12Feb 14, 2023Updated 3 years ago
- Repo for paper: Controllable Text Generation with Language Constraints☆21Jun 20, 2023Updated 3 years ago
- Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"☆75May 20, 2025Updated last year
- Source code for the paper "Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data"☆20Feb 24, 2024Updated 2 years ago
- Production-ready memory framework for AI agents. Dual-agent synthesis, self-evolution, composite scoring, multi-tenant isolation. REST AP…☆16Dec 1, 2025Updated 11 months ago
- This project collects methods that enhance the comparison between AMR graphs.☆11Jun 15, 2023Updated 3 years ago
- Accompanying repo for the RLPrompt paper☆367Jun 6, 2024Updated 2 years ago
- 定时爬取arXiv每日论文☆13May 22, 2023Updated 3 years ago
- An evaluation framework for mitigating DNN backdoor attacks using data augmentations☆11Dec 10, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A repository containing the materials required to complete the "AAAI Lab for Innovative Uses of Synthetic Data". This includes tutorials …☆12Sep 4, 2024Updated 2 years ago
- [AACL 2023] Official implementation of paper "Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompti…☆21Apr 1, 2024Updated 2 years ago
- ☆11Jul 11, 2023Updated 3 years ago
- Implementation of the report: on the domain robustness of prefix and prompt tuning☆20Mar 10, 2022Updated 4 years ago
- Official implementation for "Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition" (I…☆42May 15, 2023Updated 3 years ago
- replicantlife is a framework for generative agents that can be used in a simulation engine or standalone. Agents are powered with metacog…☆34Apr 25, 2024Updated 2 years ago
- Very concise example of integrated gradients (a method to reveal areas of attention in input images)☆10Jun 17, 2019Updated 7 years ago