IBM / unitxtLinks
π¦ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking
β212Updated last week
Alternatives and similar repositories for unitxt
Users that are interested in unitxt are comparing it to the libraries listed below
Sorting:
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ126Updated 2 months ago
- Let's build better datasets, together!β269Updated last year
- β140Updated 5 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β51Updated last year
- Manage scalable open LLM inference endpoints in Slurm clustersβ279Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learningβ191Updated 6 months ago
- awesome synthetic (text) datasetsβ321Updated 3 weeks ago
- β56Updated last month
- This is the reproduction repository for my π€ Hugging Face blog post on synthetic dataβ68Updated last year
- codebase release for EMNLP2023 paper publicationβ19Updated 4 months ago
- FastFit β‘ When LLMs are Unfit Use FastFit β‘ Fast and Effective Text Classification with Many Classesβ214Updated 4 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ72Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".β113Updated 7 months ago
- β43Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).β82Updated last year
- Notebooks for training universal 0-shot classifiers on many different tasksβ138Updated last year
- Codebase accompanying the Summary of a Haystack paper.β80Updated last year
- Evaluating LLMs with fewer examplesβ169Updated last year
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ294Updated 10 months ago
- β120Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)β104Updated 3 months ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.β64Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β69Updated 2 months ago
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"β137Updated 2 years ago
- Attribute (or cite) statements generated by LLMs back to in-context information.β317Updated last year
- Evaluating LLMs with CommonGen-Liteβ93Updated last year
- β78Updated 2 years ago
- β59Updated last year
- experiments with inference on llamaβ103Updated last year
- β161Updated last year