uds-lsv / llmftLinks
Fine-tuning large language models with huggingface transformers and deepspeed
☆31Updated last year
Alternatives and similar repositories for llmft
Users that are interested in llmft are comparing it to the libraries listed below
Sorting:
- ☆90Updated last year
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆69Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆45Updated 8 months ago
- ☆99Updated last year
- Data Valuation on In-Context Examples (ACL23)☆23Updated 7 months ago
- ☆84Updated last year
- The repository contains code for Adaptive Data Optimization☆25Updated 8 months ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆183Updated last year
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆30Updated last year
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆55Updated 2 years ago
- ☆45Updated 2 years ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 3 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- ☆31Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆163Updated 3 months ago
- Teaching Models to Express Their Uncertainty in Words☆39Updated 3 years ago
- ☆29Updated last year
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"☆108Updated 2 years ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆78Updated 7 months ago
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode …☆18Updated 8 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆31Updated 6 months ago
- ☆96Updated last year
- ☆50Updated 2 months ago
- Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…☆37Updated 2 years ago
- Self-Supervised Alignment with Mutual Information☆21Updated last year
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆113Updated last year
- Exploration of automated dataset selection approaches at large scales.☆47Updated 5 months ago
- ☆50Updated last year
- ☆51Updated 4 months ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆12Updated 4 months ago