Using open source LLMs to build synthetic datasets for direct preference optimization
☆74Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for haiku-dpo
Users that are interested in haiku-dpo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- awesome synthetic (text) datasets☆343Aug 2, 2026Updated 3 months ago
- Using short models to classify long texts☆22Mar 8, 2023Updated 3 years ago
- Use spaCy for NLP and output to the FoLiA XML format.☆12Feb 27, 2024Updated 2 years ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,451Updated this week
- German Alpaca Dataset (Cleaned + Translated)☆26Apr 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Datamodels for hugging face tokenizers☆112Oct 3, 2026Updated last month
- An opensource annotation tool.☆23Jul 7, 2026Updated 3 months ago
- Let's build better datasets, together!☆276Updated this week
- A CLI for generating synthetic data☆43May 14, 2025Updated last year
- Execute arbitrary SQL queries on 🤗 Datasets☆32Jan 24, 2024Updated 2 years ago
- ☆17Sep 29, 2026Updated last month
- A public repo that contains integrations for Argilla and LlamaIndex.☆17Oct 10, 2024Updated 2 years ago
- Simple examples using Argilla tools to build AI☆60Nov 18, 2024Updated last year
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🫠 check your data, before you wreck your model☆16Aug 11, 2022Updated 4 years ago
- Small python package to measure OCR quality and other related metrics.☆26Feb 19, 2024Updated 2 years ago
- Command Line Interface for running 🤗 Transformers Image Classification locally☆19Updated this week
- LD4 RDF and AI Workshop Jupyter notebooks☆12Jul 11, 2022Updated 4 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- Hugging Face Jobs☆20Jul 11, 2025Updated last year
- 👩🤝🤖 A curated list of datasets for large language models (LLMs), RLHF and related resources (continually updated)☆26May 2, 2023Updated 3 years ago
- a rubric driven prioritized replay rl algo to maximise continual learning☆16Oct 12, 2025Updated last year
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆900Mar 17, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- **ARCHIVED** Filesystem interface to 🤗 Hub☆60Apr 6, 2023Updated 3 years ago
- Using modal.com to process FineWeb-edu data☆21Sep 12, 2026Updated last month
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆60Oct 18, 2025Updated last year
- Official repository of Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization [EMNLP'22 …☆10May 20, 2023Updated 3 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- ☆15Mar 28, 2022Updated 4 years ago
- Genertaes control vectors for use with llama.cpp in GGUF format.☆50Mar 19, 2025Updated last year
- A bagel, with everything.☆327Apr 11, 2024Updated 2 years ago
- NMT model with BERT in tensorflow 2.0☆20Jul 24, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mixtral finetuning☆19Feb 2, 2024Updated 2 years ago
- A web app to experiment with chained prompts faster.☆16Mar 15, 2023Updated 3 years ago
- Testing speed and cost of classification via LLM or via vector embeddings☆21Aug 6, 2023Updated 3 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆70Feb 8, 2023Updated 3 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- Build datasets using natural language☆589Sep 19, 2025Updated last year
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,126Feb 2, 2025Updated last year