uds-lsv / llmftLinks
Fine-tuning large language models with huggingface transformers and deepspeed
☆31Updated last year
Alternatives and similar repositories for llmft
Users that are interested in llmft are comparing it to the libraries listed below
Sorting:
- ☆104Updated last year
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆69Updated 2 years ago
- Data Valuation on In-Context Examples (ACL23)☆24Updated 10 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆82Updated 10 months ago
- ☆85Updated last year
- The repository contains code for Adaptive Data Optimization☆28Updated 11 months ago
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆70Updated last year
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆25Updated last year
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆47Updated 11 months ago
- ☆32Updated last year
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆25Updated 2 years ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆60Updated last year
- ☆100Updated last year
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆106Updated 2 years ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 7 months ago
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆32Updated last year
- ☆101Updated 2 years ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- Self-Alignment with Principle-Following Reward Models☆169Updated last month
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆57Updated 2 years ago
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Self-Supervised Alignment with Mutual Information☆21Updated last year
- Exploration of automated dataset selection approaches at large scales.☆48Updated 8 months ago
- ☆103Updated last year
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆47Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆82Updated last year
- Pile Deduplication Code☆19Updated 2 years ago
- Teaching Models to Express Their Uncertainty in Words☆39Updated 3 years ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆121Updated last year