Official implementation for "MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models"
☆20Oct 26, 2024Updated 2 years ago
Alternatives and similar repositories for MM-Eval
Users that are interested in MM-Eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- Evaluating Reward Models in Multilingual Settings (ACL Main '25)☆45May 16, 2025Updated last year
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- 📝 are foundation LMs multilingual knowledge bases? (EMNLP 2023)☆18Dec 8, 2023Updated 2 years ago
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"☆23Oct 11, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆24Dec 2, 2023Updated 2 years ago
- ☆33Aug 30, 2023Updated 3 years ago
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Sep 12, 2024Updated 2 years ago
- [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…☆23Dec 4, 2024Updated last year
- Explaining neural decisions contrastively to alternative decisions.☆24Mar 18, 2021Updated 5 years ago
- ☆13Jan 12, 2023Updated 3 years ago
- [NeurIPS 2025] Reasoning Models Better Express Their Confidence"☆23Nov 19, 2025Updated 11 months ago
- ☆18Feb 22, 2023Updated 3 years ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Jun 13, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification☆42Apr 29, 2023Updated 3 years ago
- the benchmark for finance☆11Jul 4, 2023Updated 3 years ago
- ☆14May 8, 2023Updated 3 years ago
- Code repository for the "CMU Paper Reviewer System", a agentic system that generates reviews for academic papers.☆31Sep 2, 2026Updated 2 months ago
- Playing Breakout with double deep Q network☆13Mar 19, 2017Updated 9 years ago
- 자연어 처리 기반 [한글 서술형 수학문제 데이터셋] 공개 저장소입니다.☆14Jun 12, 2023Updated 3 years ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆260Oct 31, 2023Updated 3 years ago
- ☆13Aug 12, 2026Updated 2 months ago
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆42Dec 13, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Multilingual Large Language Models Evaluation Benchmark☆135Aug 21, 2024Updated 2 years ago
- When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).☆11Jan 30, 2025Updated last year
- Source code of our EMNLP 2024 paper "FactAlign: Long-form Factuality Alignment of Large Language Models"☆19Oct 3, 2024Updated 2 years ago
- ☆14Apr 27, 2024Updated 2 years ago
- ☆13Sep 19, 2026Updated last month
- A simple, modular, non-brittle framework for implementing text-based Reflexion agents.☆10Sep 1, 2023Updated 3 years ago
- ☆16May 21, 2026Updated 5 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆97Aug 15, 2023Updated 3 years ago
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆49Aug 21, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization☆45Mar 7, 2025Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆146Oct 27, 2024Updated 2 years ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆54Aug 10, 2025Updated last year
- A Large-Scale Dataset for Long Text and Multi-Table Summarization☆20Feb 21, 2024Updated 2 years ago
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆57Aug 26, 2024Updated 2 years ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 3 years ago
- Cardiovascular Disease Classification Employing Empirical Mode Decomposition (EMD) of Modified ECG☆11Oct 6, 2023Updated 3 years ago