IBM / unitxtLinks
π¦ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data for end-to-end AI benchmarking
β206Updated this week
Alternatives and similar repositories for unitxt
Users that are interested in unitxt are comparing it to the libraries listed below
Sorting:
- Manage scalable open LLM inference endpoints in Slurm clustersβ265Updated last year
- Let's build better datasets, together!β260Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimizationβ64Updated last year
- codebase release for EMNLP2023 paper publicationβ19Updated 2 months ago
- β128Updated 3 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ113Updated this week
- awesome synthetic (text) datasetsβ286Updated last week
- Code accompanying "How I learned to start worrying about prompt formatting".β106Updated last month
- Mixing Language Models with Self-Verification and Meta-Verificationβ106Updated 7 months ago
- This is the reproduction repository for my π€ Hugging Face blog post on synthetic dataβ68Updated last year
- β40Updated last year
- experiments with inference on llamaβ104Updated last year
- Lightweight demos for finetuning LLMs. Powered by π€ transformers and open-source datasets.β77Updated 8 months ago
- π Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.β47Updated this week
- Datasets collection and preprocessings framework for NLP extreme multitask learningβ184Updated last week
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language Mβ¦β229Updated 8 months ago
- Notebooks for training universal 0-shot classifiers on many different tasksβ130Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.β79Updated 9 months ago
- Code for the paper "Fishing for Magikarp"β157Updated 2 months ago
- Evaluating LLMs with CommonGen-Liteβ90Updated last year
- β118Updated 10 months ago
- Accelerating your LLM training to full speed! Made with β€οΈ by ServiceNow Researchβ211Updated this week
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".β206Updated last month
- β160Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated last year
- β199Updated last year
- Functional Benchmarks and the Reasoning Gapβ88Updated 9 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.β94Updated 2 months ago
- Evaluating LLMs with fewer examplesβ160Updated last year
- Website for hosting the Open Foundation Models Cheat Sheet.β267Updated 2 months ago