IBM / unitxtLinks
π¦ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking
β210Updated this week
Alternatives and similar repositories for unitxt
Users that are interested in unitxt are comparing it to the libraries listed below
Sorting:
- Let's build better datasets, together!β262Updated 9 months ago
- codebase release for EMNLP2023 paper publicationβ19Updated 3 weeks ago
- β136Updated last month
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ66Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ119Updated last week
- This is the reproduction repository for my π€ Hugging Face blog post on synthetic dataβ68Updated last year
- Manage scalable open LLM inference endpoints in Slurm clustersβ274Updated last year
- β43Updated last year
- awesome synthetic (text) datasetsβ297Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated last year
- Accelerating your LLM training to full speed! Made with β€οΈ by ServiceNow Researchβ237Updated last week
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).β80Updated last year
- Codebase accompanying the Summary of a Haystack paper.β79Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learningβ187Updated 3 months ago
- β119Updated last year
- β155Updated last year
- Notebooks for training universal 0-shot classifiers on many different tasksβ136Updated 9 months ago
- Mixing Language Models with Self-Verification and Meta-Verificationβ110Updated 9 months ago
- β52Updated 8 months ago
- β57Updated last year
- Generalist and Lightweight Model for Text Classificationβ162Updated 3 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".β110Updated 4 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on taskβ¦β179Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.β61Updated last year
- β197Updated last year
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ288Updated 7 months ago
- Lightweight demos for finetuning LLMs. Powered by π€ transformers and open-source datasets.β78Updated 11 months ago
- code for training & evaluating Contextual Document Embedding modelsβ197Updated 4 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.β87Updated 2 weeks ago
- Attribute (or cite) statements generated by LLMs back to in-context information.β291Updated last year