huggingface / data-is-better-togetherLinks
Let's build better datasets, together!
☆260Updated 7 months ago
Alternatives and similar repositories for data-is-better-together
Users that are interested in data-is-better-together are comparing it to the libraries listed below
Sorting:
- Manage scalable open LLM inference endpoints in Slurm clusters☆268Updated last year
- awesome synthetic (text) datasets☆291Updated 3 weeks ago
- ☆128Updated 3 months ago
- ☆124Updated 9 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆230Updated 9 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 9 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆284Updated 5 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- ☆118Updated 11 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆232Updated 9 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- experiments with inference on llama☆104Updated last year
- code for training & evaluating Contextual Document Embedding models☆196Updated 2 months ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆168Updated last year
- Banishing LLM Hallucinations Requires Rethinking Generalization☆276Updated last year
- ☆172Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆242Updated 8 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆204Updated this week
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆142Updated 3 weeks ago
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆135Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆185Updated 3 weeks ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆133Updated 7 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 10 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆158Updated last year
- ☆87Updated last year
- Pre-training code for Amber 7B LLM☆167Updated last year
- ☆154Updated 8 months ago
- ☆199Updated last year