princeton-nlp / LESSLinks
[ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning
☆496Updated 11 months ago
Alternatives and similar repositories for LESS
Users that are interested in LESS are comparing it to the libraries listed below
Sorting:
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆570Updated 9 months ago
- A series of technical report on Slow Thinking with LLM☆737Updated last month
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆266Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆395Updated 3 months ago
- RewardBench: the first evaluation tool for reward models.☆640Updated 3 months ago
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆383Updated 8 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆516Updated 8 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆258Updated last year
- ☆549Updated 9 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆341Updated last year
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆246Updated last month
- ☆341Updated 3 months ago
- ☆307Updated last year
- The related works and background techniques about Openai o1☆222Updated 8 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆165Updated last year
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆668Updated 8 months ago
- Collection of training data management explorations for large language models☆334Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆374Updated last year
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆275Updated 2 years ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆353Updated last year
- ☆318Updated 4 months ago
- A Survey on Data Selection for Language Models☆250Updated 5 months ago
- ☆211Updated 7 months ago
- The repo for In-context Autoencoder☆140Updated last year
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆923Updated 7 months ago
- LLM hallucination paper list☆323Updated last year
- Generative Judge for Evaluating Alignment☆246Updated last year
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆325Updated last year
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆244Updated 5 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆187Updated last month