microsoft / llm-data-creationLinks
Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
☆137Updated 2 years ago
Alternatives and similar repositories for llm-data-creation
Users that are interested in llm-data-creation are comparing it to the libraries listed below
Sorting:
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- awesome synthetic (text) datasets☆321Updated last week
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆126Updated 2 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆244Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆120Updated 2 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆236Updated 3 months ago
- ☆162Updated last year
- ☆147Updated last year
- ☆42Updated last year
- Open Implementations of LLM Analyses☆107Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆156Updated 2 years ago
- Let's build better datasets, together!☆269Updated last year
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆151Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆113Updated 7 months ago
- ☆82Updated 2 months ago
- ☆129Updated last year
- Official repo for "Make Your LLM Fully Utilize the Context"☆261Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆278Updated last year
- Notebooks for training universal 0-shot classifiers on many different tasks☆137Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆103Updated 5 months ago
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆258Updated 5 months ago
- ☆120Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆114Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆183Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆72Updated last year
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆167Updated 2 years ago
- Evaluating LLMs with fewer examples☆169Updated last year