π€ Evaluate: A library for easily evaluating machine learning models and datasets.
β2,498Nov 16, 2026Updated this week
Alternatives and similar repositories for evaluate
Users that are interested in evaluate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π Accelerate inference and training of π€ Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimizationβ¦β3,525Updated this week
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,952Updated this week
- π€ The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation toolsβ22,178Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsβ2,587Updated this week
- π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.β21,912Updated this week
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- π₯ Fast State-of-the-Art Tokenizers optimized for Research and Productionβ11,270Updated this week
- Train transformer language models with reinforcement learning.β19,788Updated this week
- Accessible large language models via k-bit quantization for PyTorch.β8,548Nov 2, 2026Updated 2 weeks ago
- Efficient few-shot learning with Sentence Transformersβ2,869Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.β3,429Updated this week
- Large Language Model Text Generation Inferenceβ10,876Mar 21, 2026Updated 8 months ago
- State-of-the-Art Embeddings, Retrieval, and Rerankingβ19,297Updated this week
- A framework for few-shot evaluation of language models.β14,515Nov 4, 2026Updated 2 weeks ago
- Robust recipes to align language models with human and AI preferencesβ5,716Sep 23, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Simple, safe way to store and distribute tensorsβ3,974Updated this week
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)β4,755Jan 8, 2024Updated 2 years ago
- Supercharge Your Model Trainingβ5,503Apr 29, 2026Updated 6 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β43,347Updated this week
- π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.β34,961Updated this week
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.β31,468Updated this week
- Toolkit for creating, sharing and using natural language prompts.β3,044Oct 23, 2023Updated 3 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learningβ2,833Apr 26, 2026Updated 6 months ago
- π€ Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal modelβ¦β169,344Updated this week
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.β32,206Sep 30, 2025Updated last year
- PyTorch native post-training libraryβ5,820Updated this week
- Minimalistic large language model 3D-parallelism trainingβ2,869Oct 8, 2026Updated last month
- Hackable and optimized Transformers building blocks, supporting a composable construction.β10,580Nov 13, 2026Updated last week
- Fast and memory-efficient exact attentionβ25,330Updated this week
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasetsβ5,208Updated this week
- β3,007Aug 3, 2026Updated 3 months ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ22,247Sep 21, 2026Updated 2 months ago
- Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language modelsβ3,243Jul 19, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Unsupervised text tokenizer for Neural Network-based text generation.β12,174Updated this week
- Ongoing research training transformer models at scaleβ18,451Updated this week
- A modular RL library to fine-tune language models to human preferencesβ2,399Mar 1, 2024Updated 2 years ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.β1,266Nov 12, 2026Updated last week
- An open collection of implementation tips, tricks and resources for training large language modelsβ506Mar 8, 2023Updated 3 years ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.β19,777Apr 14, 2026Updated 7 months ago
- The official CLI and Python client for the Hugging Face Hub.β4,060Updated this week
Are these results useful?