Open-source library for scalable, reproducible evaluation of AI models and benchmarks.
☆307Jul 3, 2026Updated this week
Alternatives and similar repositories for Evaluator
Users that are interested in Evaluator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Jun 5, 2025Updated last year
- [EMNLP 2025] The official implementation of "Zero-shot Multimodal Document Retrieval via Cross-Modal Question Generation"☆15Aug 26, 2025Updated 10 months ago
- BERT score for text generation☆12Jan 15, 2025Updated last year
- 🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.☆17Jun 5, 2025Updated last year
- 🔭 interactively explore `onnx` networks in your CLI.☆27Jun 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆73Aug 24, 2025Updated 10 months ago
- [COLING'25] Gen-SQL: Efficient Text-to-SQL By Bridging Natural Language Question And Database Schema With Pseudo-Schema☆23Jul 9, 2025Updated 11 months ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Aug 24, 2024Updated last year
- ☆55Feb 11, 2025Updated last year
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated last year
- StrategyQA 데이터 세트 번역☆22Apr 12, 2024Updated 2 years ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆185Jun 16, 2026Updated 2 weeks ago
- Rust crate for some audio utilities☆28Jun 17, 2026Updated 2 weeks ago
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code for the paper "Closing the Curious Case of Neural Text Degeneration"☆12Apr 9, 2025Updated last year
- 한국어 심리 상담 데이터셋☆81Jun 20, 2023Updated 3 years ago
- Bias, Hate classification with KoELECTRA 👿☆27Jun 12, 2023Updated 3 years ago
- Reproducible and flexible LLM evaluations for scientific reasoning.☆28Jul 23, 2025Updated 11 months ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆48Dec 23, 2024Updated last year
- ☆31Sep 12, 2025Updated 9 months ago
- Miscellaneous codes and writings for MLOps☆15Apr 8, 2026Updated 2 months ago
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆21Sep 17, 2025Updated 9 months ago
- KoCLIP: Korean port of OpenAI CLIP, in Flax☆155Dec 28, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- #인권코퍼스☆31Oct 6, 2023Updated 2 years ago
- SLM-SQL: An Exploration of Small Language Models for Text-to-SQL☆35Aug 12, 2025Updated 10 months ago
- Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.☆42Updated this week
- FeedbackQA: Improving Question Answering Post-Deployment with Interactive Feedback☆12Jul 13, 2022Updated 3 years ago
- A recipe for constituency parsing, disfluency tagging and obtaining the fluent transcripts of English Fisher dataset☆13May 2, 2021Updated 5 years ago
- Test LLMs against jailbreaks and unprecedented harms☆41Oct 19, 2024Updated last year
- REverse-Engineered Reasoning for Open-Ended Generation☆98Sep 10, 2025Updated 9 months ago
- This is a hands-on for ML beginners to perform SimCSE step-by-step. Implemented both supervised SimCSE and unsupervisied SimCSE, and dist…☆22Oct 6, 2023Updated 2 years ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Mar 20, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tool to configure, launch and manage your machine learning experiments.☆250Jun 29, 2026Updated last week
- Reward Model을 이용하여 언어모델의 답변을 평가하기☆30Feb 23, 2024Updated 2 years ago
- Text generation using language models with multiple exit heads☆16Sep 18, 2025Updated 9 months ago
- Retrieval-Augmented Generation battle!☆67Apr 18, 2026Updated 2 months ago
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆25Jun 3, 2026Updated last month
- The contrastive token loss function for reducing generative repetition of autoregressive neural language models.☆13May 11, 2022Updated 4 years ago
- ☆27Apr 1, 2026Updated 3 months ago