Accepted to ICLR 2025. MetaMetrics is a calibrated meta-metric designed to evaluate generation tasks across different modalities aligned with alignment with human preferences.
☆15Dec 30, 2024Updated last year
Alternatives and similar repositories for metametrics
Users that are interested in metametrics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- R3: Robust Rubric-Agnostic Reward Models☆24Jul 12, 2025Updated last year
- WorldCuisines is an extensive multilingual and multicultural benchmark that spans 30 languages, covering a wide array of global cuisines.…☆28May 8, 2025Updated last year
- Repo for arxiv paper "A Systematic Study of Code Obfuscation Against LLM-based Vulnerability Detection".☆15Dec 18, 2025Updated 10 months ago
- A library of translation-based text similarity measures☆25Dec 11, 2023Updated 2 years ago
- ☆22Apr 5, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆154Jul 2, 2026Updated 4 months ago
- ☆10Jun 5, 2024Updated 2 years ago
- ☆26Oct 27, 2025Updated last year
- [WWW'25] Official repo for paper: RU-AI: A Large Multimodal Dataset for Machine Generated Content Detection☆10Aug 8, 2026Updated 2 months ago
- [ACL 2023] Code and Data Repo for Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"☆56Jan 21, 2024Updated 2 years ago
- ☆33Jun 20, 2018Updated 8 years ago
- Dataset Catalogue Homepage for Indonesian Languages☆12Feb 19, 2024Updated 2 years ago
- A framework for evaluating Machine Translation models.☆14Oct 1, 2026Updated last month
- Modified version of fairseq, including new implementations for criterions using reinforcement learning methods.☆11Aug 14, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A repository for experiments in quality-aware decoding☆18Jun 7, 2022Updated 4 years ago
- replication code for EMNLP 2021 paper☆11Nov 15, 2021Updated 4 years ago
- Extend bert-nmt to context-aware translation.☆11May 24, 2021Updated 5 years ago
- Play galgame on macOS☆25Updated this week
- ☆13Jul 17, 2025Updated last year
- Auto Model Factorization☆12Sep 14, 2021Updated 5 years ago
- An Interactive Tool for Annotating Discourse Structure and Text Improvement☆16Sep 15, 2021Updated 5 years ago
- Towards Few-Shot Fact-Checking via Perplexity☆13Jun 11, 2021Updated 5 years ago
- ☆16Sep 30, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Trustworthy Machine Learning Algorithm Library☆12Jul 1, 2024Updated 2 years ago
- ☆12Jun 30, 2025Updated last year
- ☆11Aug 10, 2025Updated last year
- [ICML 2022 Spotlight] Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks☆11May 21, 2023Updated 3 years ago
- Code for CVPR2018 "Iterative Learning with Open-set Noisy Labels"☆12Mar 12, 2021Updated 5 years ago
- ☆15Nov 29, 2018Updated 7 years ago
- ☆11Jun 23, 2022Updated 4 years ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 4 years ago
- [EMNLP2025] Remedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling☆16Nov 20, 2025Updated 11 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 基于 Anatole 开发的 Halo 博客主题 Knarc☆13Apr 6, 2023Updated 3 years ago
- Official Code for ICLR 2023 Paper: A Message Passing Perspective on Learning Dynamics of Contrastive Learning☆12Mar 9, 2023Updated 3 years ago
- Code for ICML 2024 Paper "PID: Prompt-Independent Data Protection Against Latent Diffusion Models"☆12Jan 27, 2025Updated last year
- SemEval 2019 Task 4: Hyperpartisan News Detection☆13Nov 9, 2019Updated 6 years ago
- [AAAI 2024] DataElixir: Purifying Poisoned Dataset to Mitigate Backdoor Attacks via Diffusion Models☆12Dec 5, 2024Updated last year
- MINERS ⛏️: The semantic retrieval benchmark for evaluating multilingual language models. (EMNLP 2024 Findings)☆14Oct 3, 2024Updated 2 years ago
- Sum up the pages of all pdf files in a directory☆15Apr 7, 2020Updated 6 years ago