datadreamer-dev / DataDreamerLinks
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. β π€π€
β1,062Updated 8 months ago
Alternatives and similar repositories for DataDreamer
Users that are interested in DataDreamer are comparing it to the libraries listed below
Sorting:
- Evaluate your LLM's response with Prometheus and GPT4 π―β996Updated 5 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.β793Updated 2 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifiβ¦β2,899Updated last week
- Automatically evaluate your LLMs in Google Colabβ661Updated last year
- Easily embed, cluster and semantically label text datasetsβ578Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.β1,543Updated 4 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.β2,660Updated last week
- Stanford NLP Python library for Representation Finetuning (ReFT)β1,514Updated 8 months ago
- Best practices for distilling large language models.β577Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ1,973Updated this week
- Train Models Contrastively in Pytorchβ750Updated 6 months ago
- β541Updated 10 months ago
- Generative Representational Instruction Tuningβ674Updated 3 months ago
- Automated Evaluation of RAG Systemsβ658Updated 6 months ago
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuningβ661Updated last year
- β1,034Updated 9 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipyβ1,346Updated 3 weeks ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAIβ1,401Updated last year
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.β492Updated last year
- β1,088Updated last year
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".β640Updated 2 months ago
- Data and tools for generating and inspecting OLMo pre-training data.β1,321Updated last week
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.β536Updated 3 weeks ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"β470Updated last year
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.β440Updated last year
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"β1,336Updated 7 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retrainingβ720Updated last year
- A reading list on LLM based Synthetic Data Generation π₯β1,423Updated 4 months ago
- LLM Analyticsβ686Updated 11 months ago
- Synthetic data curation for post-training and structured data extractionβ1,511Updated 2 months ago