MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA models.
☆46Apr 17, 2026Updated this week
Alternatives and similar repositories for MERA
Users that are interested in MERA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 2 years ago
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Apr 2, 2025Updated last year
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated 7 months ago
- ☆21Feb 10, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆31Sep 23, 2024Updated last year
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆22Nov 14, 2025Updated 5 months ago
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆25Oct 11, 2022Updated 3 years ago
- Training and data processing code for Saiga☆54Jan 2, 2026Updated 3 months ago
- ☆23Aug 26, 2024Updated last year
- [ACL 2025] Adaptive Retrieval without Self-Knowledge? Bringing Uncertainty Back Home☆18May 17, 2025Updated 11 months ago
- [NAACL 2025] Official Code Repository for the paper "Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval"☆21Jul 13, 2025Updated 9 months ago
- ☆34Apr 14, 2025Updated last year
- Automated machine learning for text classification☆53Apr 11, 2026Updated last week
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Tools and agents for automated research.☆53Dec 5, 2025Updated 4 months ago
- Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…☆23Apr 16, 2025Updated last year
- Implementation of the CodeAct agentic framework with Docker containers for security, MCP servers for tool integrations, and multi-agent s…☆40Oct 22, 2025Updated 5 months ago
- Code example for pretraining an LLM with vanilla PyTorch training loop☆10Jun 6, 2024Updated last year
- A simple tool that allow you to disconnect and reconnect quickly to save time in battlegrounds.☆12Sep 22, 2020Updated 5 years ago
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆20Feb 8, 2026Updated 2 months ago
- ITMO AI Talent Hub Speech Recognition and Generation course☆13Apr 8, 2026Updated last week
- ☆87Oct 19, 2022Updated 3 years ago
- Models for automatically transforming toxic text to neutral☆38Oct 5, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Позволяет конвертировать набор выписок из ЕГРН (Росреестра) на земельные участки, здания, сооружения, помещения в формат ESRI Shapefile (…☆33Jul 12, 2023Updated 2 years ago
- The tiniest sentence encoder for Russian language☆245Jul 25, 2024Updated last year
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆54Jul 15, 2025Updated 9 months ago
- ☆11Dec 11, 2024Updated last year
- Library for industrial alignment.☆405Sep 24, 2025Updated 6 months ago
- ☆24Apr 15, 2021Updated 5 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- Retrieval-Augmented Generation with pgvector as vector database☆13Jan 23, 2024Updated 2 years ago
- Testing KAN-based text generation GPT models☆18May 6, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- OpenAI compatible API for TensorRT LLM triton backend☆219Aug 1, 2024Updated last year
- Foundational Model for Speech Recognition Tasks☆547Updated this week
- Convert MUSE from TensorFlow to PyTorch and ONNX☆11May 22, 2024Updated last year
- NS course☆17Sep 17, 2020Updated 5 years ago
- Fast and memory-efficient exact attention☆20Apr 10, 2026Updated last week
- This is a Tourism Website about Matiari District and information related to it's History, Famous places to visit, hospitals, Bus stops, …☆23Aug 2, 2020Updated 5 years ago
- Official Implementation for "Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing"☆55Sep 12, 2024Updated last year