MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA models.
☆54Nov 2, 2026Updated this week
Alternatives and similar repositories for MERA
Users that are interested in MERA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆63Oct 7, 2024Updated 2 years ago
- MERA Code — the first comprehensive open benchmark for evaluating large language models (LLMs) in applied programming tasks in Russian.☆15Sep 14, 2026Updated last month
- ☆10Oct 16, 2026Updated 3 weeks ago
- ☆14Feb 13, 2026Updated 8 months ago
- ☆24Aug 12, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆34Apr 14, 2025Updated last year
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Apr 2, 2025Updated last year
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆169Dec 8, 2025Updated 10 months ago
- Effective LLM Alignment Toolkit☆155Jun 25, 2025Updated last year
- Event2mind for Russian: dataset and model☆10Jun 18, 2020Updated 6 years ago
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆22Nov 14, 2025Updated 11 months ago
- Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…☆25Apr 16, 2025Updated last year
- ☆13Mar 19, 2024Updated 2 years ago
- LaTeX Template for the Dialogue Conference.☆11Dec 27, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Бенчмарк для оценки способности LLM-моделей писать код на 1С☆16Jun 12, 2026Updated 4 months ago
- An open-source pipeline for training natural language understanding models☆58Jun 19, 2026Updated 4 months ago
- ☆31Sep 23, 2024Updated 2 years ago
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆21Feb 8, 2026Updated 8 months ago
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated last year
- [arXiv:2603.18859] "RewardFlow: Topology-Aware Reward Propagation on State Graphs for Agentic RL with Large Language Models"☆13Jun 5, 2026Updated 5 months ago
- PPO and PyMARL baseline for Pogema environment☆24Sep 18, 2024Updated 2 years ago
- ☆18Dec 8, 2025Updated 10 months ago
- Augmentex — a library for augmenting texts with errors☆68Jul 3, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Evaluation tools for Automatic Speech Recognition (ASR), model and dataset collection☆32Mar 9, 2026Updated 7 months ago
- Training and data processing code for Saiga☆56Jan 2, 2026Updated 10 months ago
- ☆19May 3, 2026Updated 6 months ago
- Tools and agents for automated research.☆56Dec 5, 2025Updated 11 months ago
- Structured decisions over Russian text in one encoder pass: choice, scale, yes/no, ranking☆34Oct 21, 2026Updated 2 weeks ago
- ⚡ Набор решений для разработки LLM-приложений на русском языке с поддержкой GigaChat ⚡☆592Sep 8, 2026Updated last month
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆25Oct 11, 2022Updated 4 years ago
- ☆23Apr 15, 2021Updated 5 years ago
- A pandoc Typst template to convert markdown files to PDF or Typst.☆14May 18, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fast and customizable framework for automatic ML model creation (AutoML)☆1,483Updated this week
- ☆180Updated this week
- FusionBrain Challenge 2.0: creating multimodal multitask model☆15Oct 29, 2022Updated 4 years ago
- T5-based (russian) text normalization☆28Jan 25, 2024Updated 2 years ago
- ☆21Jul 2, 2024Updated 2 years ago
- SIRIN is a Python library for detecting and analyzing contextual inconsistencies in systems that use LLMs☆64Sep 28, 2026Updated last month
- A library built upon PyTorch for building embeddings on discrete event sequences using self-supervision☆266Sep 24, 2026Updated last month