Alternatives and similar repositories for awesome-synthetic-datasets

Users that are interested in awesome-synthetic-datasets are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆256Updated 10 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆216Updated 6 months ago
• huggingface / cosmopedia
  ☆515Updated 5 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆239Updated 6 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 4 months ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆295Updated this week
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆459Updated last year
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆203Updated 2 weeks ago
• writer / writing-in-the-margins
  ☆117Updated 8 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆132Updated last year
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆229Updated 7 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆218Updated 5 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆451Updated 11 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆135Updated 6 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆312Updated last month
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆382Updated this week
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆353Updated 8 months ago
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆697Updated last month
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆195Updated this week
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆235Updated 2 months ago
• Re-Align / URIAL
  ☆309Updated 11 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆206Updated 6 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆532Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆276Updated 2 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆184Updated this week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last month
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆301Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆622Updated last year