IBM / unitxt
🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
☆160Updated this week
Related projects ⓘ
Alternatives and complementary repositories for unitxt
- codebase release for EMNLP2023 paper publication☆19Updated 8 months ago
- A package dedicated for running benchmark agreement testing☆13Updated this week
- Open source project for data preparation of LLM application builders☆300Updated this week
- ☆106Updated 2 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆129Updated this week
- Let's build better datasets, together!☆206Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆237Updated 4 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆95Updated last month
- A framework for few-shot evaluation of autoregressive language models.☆13Updated 9 months ago
- awesome synthetic (text) datasets☆242Updated 3 weeks ago
- This is the official repository for Inheritune.☆105Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆195Updated 2 weeks ago
- MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]☆103Updated last month
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 8 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆40Updated 8 months ago
- ☆214Updated last week
- ☆128Updated this week
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- Prune transformer layers☆64Updated 5 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆57Updated last month
- ☆112Updated last month
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆149Updated 4 months ago
- ☆120Updated this week
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- The official evaluation suite and dynamic data release for MixEval.☆224Updated last week
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆80Updated 2 months ago
- Attribute (or cite) statements generated by LLMs back to in-context information.☆147Updated last month
- code for training & evaluating Contextual Document Embedding models☆117Updated last week
- Automatic Evals for Instruction-Tuned Models☆45Updated this week