Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
☆138Oct 19, 2023Updated 2 years ago
Alternatives and similar repositories for llm-data-creation
Users that are interested in llm-data-creation are comparing it to the libraries listed below
Sorting:
- ICML 2025 Spotlight, PCEvolve: Private Contrastive Evolution for Synthetic Dataset Generation via Few-Shot Private Data and Generative AP…☆14Jun 27, 2025Updated 8 months ago
- Targeted Data Generation with Large Language Models☆19Jun 25, 2024Updated last year
- ☆24May 19, 2024Updated last year
- Official repository for Trustworthy Alignment of Retrieval-Augmented Large Language Models via Reinforcement Learning☆12Sep 2, 2024Updated last year
- Conference talk: from zero to your first LLM application☆17Jul 1, 2024Updated last year
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 3 years ago
- A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …☆23Oct 1, 2024Updated last year
- Synthetic Data for LLM Fine-Tuning☆122Dec 5, 2023Updated 2 years ago
- Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.☆32Apr 26, 2021Updated 4 years ago
- ☆20Aug 5, 2024Updated last year
- ☆13Nov 5, 2024Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆106Oct 31, 2024Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆53Jun 24, 2024Updated last year
- ☆23Aug 30, 2024Updated last year
- ViSD4SA, a Vietnamese Span Detection for Aspect-based sentiment analysis dataset☆17Oct 4, 2022Updated 3 years ago
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Apr 29, 2024Updated last year
- Reference code base for ML Engineering in Action, Manning Publications Author: Ben Wilson☆20Oct 22, 2023Updated 2 years ago
- Creates an Azure AI Service and deploys the specified models.☆18Aug 22, 2025Updated 6 months ago
- examples and guides to using Nomic Atlas☆37Apr 18, 2025Updated 11 months ago
- State of What Art? A Call for Multi-Prompt LLM Evaluation☆15Jul 10, 2024Updated last year
- ☆26Jun 17, 2024Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆156Nov 2, 2023Updated 2 years ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆514May 20, 2024Updated last year
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,100Feb 2, 2025Updated last year
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆367Sep 6, 2024Updated last year
- Generate Structured JSON with probs from Language Models☆17Mar 23, 2025Updated 11 months ago
- [AAAI 2025]Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity☆30Mar 17, 2025Updated last year
- AI Starter Kit for AI applications in Drone technology using Intel® Optimized Tensorflow*☆18May 8, 2024Updated last year
- ☆31Mar 23, 2024Updated last year
- ☆23Aug 7, 2023Updated 2 years ago
- ☆11Dec 15, 2025Updated 3 months ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Jan 15, 2024Updated 2 years ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,121Mar 9, 2026Updated last week
- awesome synthetic (text) datasets☆325Jan 8, 2026Updated 2 months ago
- Few-shot Learning with Auxiliary Data☆31Dec 8, 2023Updated 2 years ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆285Aug 20, 2023Updated 2 years ago
- ☆52Jun 14, 2024Updated last year
- ☆567Nov 20, 2024Updated last year
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆61Oct 3, 2024Updated last year