OFA-Sys / InsTag
InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
☆256Updated last year
Alternatives and similar repositories for InsTag:
Users that are interested in InsTag are comparing it to the libraries listed below
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆363Updated 7 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆149Updated 7 months ago
- ☆276Updated 9 months ago
- ☆140Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆553Updated 4 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆260Updated 7 months ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆115Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆139Updated 10 months ago
- Generative Judge for Evaluating Alignment☆236Updated last year
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆249Updated 4 months ago
- Collection of training data management explorations for large language models☆322Updated 9 months ago
- ☆169Updated last year
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆169Updated 10 months ago
- ☆143Updated 10 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆81Updated 2 months ago
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆242Updated 2 weeks ago
- LongQLoRA: Extent Context Length of LLMs Efficiently☆164Updated last year
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆125Updated 11 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆131Updated 2 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆154Updated 10 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆182Updated 6 months ago
- Naive Bayes-based Context Extension☆326Updated 4 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆78Updated 5 months ago
- ☆327Updated 2 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆85Updated 9 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆441Updated 6 months ago
- ☆98Updated 7 months ago
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆323Updated 7 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆323Updated last year