IBM / unitxtLinks
π¦ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking
β206Updated this week
Alternatives and similar repositories for unitxt
Users that are interested in unitxt are comparing it to the libraries listed below
Sorting:
- Let's build better datasets, together!β260Updated 7 months ago
- Manage scalable open LLM inference endpoints in Slurm clustersβ268Updated last year
- β129Updated 4 months ago
- awesome synthetic (text) datasetsβ291Updated last month
- β118Updated 11 months ago
- This is the reproduction repository for my π€ Hugging Face blog post on synthetic dataβ68Updated last year
- β41Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ65Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ114Updated 3 weeks ago
- Code accompanying "How I learned to start worrying about prompt formatting".β107Updated last month
- experiments with inference on llamaβ104Updated last year
- codebase release for EMNLP2023 paper publicationβ19Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.β79Updated 10 months ago
- Lightweight demos for finetuning LLMs. Powered by π€ transformers and open-source datasets.β77Updated 9 months ago
- Accelerating your LLM training to full speed! Made with β€οΈ by ServiceNow Researchβ218Updated this week
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ284Updated 5 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).β80Updated last year
- Attribute (or cite) statements generated by LLMs back to in-context information.β268Updated 10 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learningβ185Updated 3 weeks ago
- Evaluating LLMs with fewer examplesβ160Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"β115Updated 10 months ago
- β152Updated last year
- β261Updated last month
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"β135Updated last year
- Official repo for "Make Your LLM Fully Utilize the Context"β253Updated last year
- Website for hosting the Open Foundation Models Cheat Sheet.β267Updated 3 months ago
- β154Updated 8 months ago
- β244Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignmentβ60Updated 11 months ago