Accepted to ICLR 2025. MetaMetrics is a calibrated meta-metric designed to evaluate generation tasks across different modalities aligned with alignment with human preferences.
☆14Dec 30, 2024Updated last year
Alternatives and similar repositories for metametrics
Users that are interested in metametrics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- R3: Robust Rubric-Agnostic Reward Models☆20Jul 12, 2025Updated 9 months ago
- WorldCuisines is an extensive multilingual and multicultural benchmark that spans 30 languages, covering a wide array of global cuisines.…☆27May 8, 2025Updated 11 months ago
- URIEL+ knowledge base for natural language processing☆17Dec 16, 2025Updated 4 months ago
- Softened ROSA QKV Operators for Training Next-Generation LLM Models☆36Apr 7, 2026Updated last week
- ☆139Apr 8, 2026Updated last week
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This project demonstrates function-calling with Python and Ollama, utilizing the Africa's Talking API to send airtime and messages to pho…☆20Apr 10, 2026Updated last week
- A library of translation-based text similarity measures☆25Dec 11, 2023Updated 2 years ago
- MonAPI: Democratizing API Monitoring Tools through Open Source☆28Jan 13, 2023Updated 3 years ago
- Official implementation for "MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models"☆19Oct 26, 2024Updated last year
- Multilingual Entity Linking model by BELA model☆12Jul 20, 2023Updated 2 years ago
- Dataset Catalogue Homepage for Indonesian Languages☆10Feb 19, 2024Updated 2 years ago
- Modified version of fairseq, including new implementations for criterions using reinforcement learning methods.☆11Aug 14, 2019Updated 6 years ago
- [ICLR 2026] The official implementation of the paper “Anchored Supervised Fine-Tuning”☆35Feb 12, 2026Updated 2 months ago
- A powerful CLI application for automated AI-powered video generation. Create engaging short-form videos for TikTok, YouTube Shorts, and I…☆35Nov 28, 2025Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆33Jun 20, 2018Updated 7 years ago
- A framework for evaluating Machine Translation models.☆12May 26, 2025Updated 10 months ago
- SemEval 2019 Task 4: Hyperpartisan News Detection☆10Nov 9, 2019Updated 6 years ago
- Siamese graph convolutional network for content based remote sensing image retrieval☆14Sep 13, 2021Updated 4 years ago
- SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters (ICLR 2025)☆17Aug 22, 2025Updated 7 months ago
- [2018-Runner Up Prizes for Bookdown contest] MSc Dissertation on "Spatial Generalized Linear Mixed Models and Its Applications" (China U…☆16Jun 28, 2020Updated 5 years ago
- Word-level language identification for Bangla-English code-mixed social media data, using a BiLSTM with subword embeddings.☆10Aug 13, 2023Updated 2 years ago
- Fast syllable estimation library based on pattern matching.☆41Mar 1, 2026Updated last month
- Fine-tuning open-source large and small instruct/chat language models (LLMs & SLMs) from the Hugging Face Model Hub using public datasets…☆19Aug 31, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A repository for experiments in quality-aware decoding☆18Jun 7, 2022Updated 3 years ago
- This is the github to open source benchmark AdvancedIF, see LAMA L1387358RCRO☆31Nov 26, 2025Updated 4 months ago
- Official repository of "Zero-Shot Character Identification and Speaker Prediction in Comics via Iterative Multimodal Fusion" (ACMMM 2024)☆15Oct 31, 2024Updated last year
- [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆20Apr 9, 2025Updated last year
- ☆15Sep 30, 2023Updated 2 years ago
- MonAPI: Democratizing API Monitoring Tools through Open Source☆43Apr 23, 2024Updated last year
- Extend bert-nmt to context-aware translation.☆11May 24, 2021Updated 4 years ago
- Arabic Speech Recognition with Whisper: Fine-tune the Whisper model from OpenAI for Arabic speech recognition tasks. This repository prov…☆21Feb 28, 2024Updated 2 years ago
- ☆12Jun 30, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for CVPR2018 "Iterative Learning with Open-set Noisy Labels"☆12Mar 12, 2021Updated 5 years ago
- ☆11Jun 23, 2022Updated 3 years ago
- ☆12Nov 28, 2022Updated 3 years ago
- Towards Few-Shot Fact-Checking via Perplexity☆13Jun 11, 2021Updated 4 years ago
- NTREX -- News Test References for MT Evaluation☆87Jun 5, 2024Updated last year
- [ICML 2022 Spotlight] Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks☆11May 21, 2023Updated 2 years ago
- Official Code for ICLR 2023 Paper: A Message Passing Perspective on Learning Dynamics of Contrastive Learning☆11Mar 9, 2023Updated 3 years ago