davanstrien / awesome-synthetic-datasetsView external linksLinks
awesome synthetic (text) datasets
☆323Jan 8, 2026Updated last month
Alternatives and similar repositories for awesome-synthetic-datasets
Users that are interested in awesome-synthetic-datasets are comparing it to the libraries listed below
Sorting:
- Let's build better datasets, together!☆270Dec 20, 2024Updated last year
- ☆80Jun 5, 2024Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,084Jan 26, 2026Updated 2 weeks ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Mar 12, 2024Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,885Updated this week
- Curated list of datasets and tools for post-training.☆4,242Nov 10, 2025Updated 3 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Oct 8, 2025Updated 4 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆151Jan 20, 2025Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,852May 17, 2025Updated 8 months ago
- ☆162Dec 2, 2024Updated last year
- Chrome Extension for exploring Hugging Face datasets 🔎☆48Sep 18, 2024Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆22Oct 10, 2024Updated last year
- a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker …☆110May 31, 2024Updated last year
- utilities for loading and running text embeddings with onnx☆45Aug 16, 2025Updated 5 months ago
- ☆32Jul 5, 2024Updated last year
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,093Feb 2, 2025Updated last year
- Easily embed, cluster and semantically label text datasets☆593Mar 28, 2024Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,293Jan 21, 2026Updated 3 weeks ago
- Simple repository for training small reasoning models☆49Feb 6, 2025Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆72Feb 29, 2024Updated last year
- Robust recipes to align language models with human and AI preferences☆5,495Sep 8, 2025Updated 5 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,486Feb 4, 2026Updated last week
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆39Nov 21, 2025Updated 2 months ago
- An introduction to LLM Sampling☆79Dec 15, 2024Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Jan 19, 2024Updated 2 years ago
- ☆13May 7, 2023Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 4 months ago
- ☆21Oct 14, 2024Updated last year
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆26Mar 6, 2025Updated 11 months ago
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆21Feb 26, 2024Updated last year
- Late Interaction Models Training & Retrieval☆701Updated this week
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆77Updated this week
- Build datasets using natural language☆566Sep 19, 2025Updated 4 months ago
- Go ahead and axolotl questions☆11,289Updated this week
- Tools for merging pretrained large language models.☆6,783Jan 26, 2026Updated 2 weeks ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆820Jul 15, 2025Updated 7 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Apr 29, 2024Updated last year
- Code for Zero-Shot Tokenizer Transfer☆142Jan 14, 2025Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆156Jul 14, 2025Updated 7 months ago