MMLU eval for RU/EN
☆16Jul 31, 2023Updated 3 years ago
Alternatives and similar repositories for mmlu_ru
Users that are interested in mmlu_ru are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆61Sep 26, 2023Updated 2 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆63Oct 7, 2024Updated last year
- Git Hooks Tutorial.☆17Jul 6, 2022Updated 4 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆52Sep 14, 2026Updated last week
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- RuQualBench: A benchmark for evaluating the quality of the Russian language in LLM responses☆22Jun 23, 2026Updated 2 months ago
- Code example for pretraining an LLM with vanilla PyTorch training loop☆10Jun 6, 2024Updated 2 years ago
- Language modeling and instruction tuning for Russian☆465Aug 20, 2024Updated 2 years ago
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆20Feb 8, 2026Updated 7 months ago
- Training and data processing code for Saiga☆56Jan 2, 2026Updated 8 months ago
- Models for automatically transforming toxic text to neutral☆38Oct 5, 2023Updated 2 years ago
- Analyze a real-time IPv4 packet stream and export metrics about the data flows☆14Jan 29, 2020Updated 6 years ago
- Russian SuperGLUE benchmark☆113Jun 12, 2023Updated 3 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆160May 22, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tools and scripts for experimenting with Transformers: Bert, T5...☆61Jan 6, 2024Updated 2 years ago
- Package for word stress detection☆11Jan 27, 2023Updated 3 years ago
- Vulnerability Knowledge Base comparison tool☆13Feb 9, 2022Updated 4 years ago
- A wrapper script for https://sploitus.com to scrape query results for tools and exploits☆14Mar 3, 2019Updated 7 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogue☆33Jan 4, 2023Updated 3 years ago
- Building reliable Retrieval Augmented Generation(RAG) AI Architecture☆13Jul 30, 2024Updated 2 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆168Dec 8, 2025Updated 9 months ago
- ☆24Apr 15, 2021Updated 5 years ago
- Many things I've done with different programming languages☆14Aug 26, 2020Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆12Mar 24, 2024Updated 2 years ago
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Jun 1, 2024Updated 2 years ago
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Apr 2, 2025Updated last year
- This is a Tourism Website about Matiari District and information related to it's History, Famous places to visit, hospitals, Bus stops, …☆23Aug 2, 2020Updated 6 years ago
- ☆12Aug 15, 2018Updated 8 years ago
- notes on applied computer security☆11Jun 27, 2023Updated 3 years ago
- Career Assistant: Search for IT Companies Careers without going to their careers page☆13Updated this week
- ☆10Jun 19, 2022Updated 4 years ago
- Forecasting of forest drought impacts in Switzerland from satellite imagery, weather reanalysis and remote sensing data. Pixel-wise forec…☆15Sep 14, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The tiniest sentence encoder for Russian language☆246Jul 25, 2024Updated 2 years ago
- a collection of tools and python libraries for use in medical practice and research☆12Nov 22, 2025Updated 10 months ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 4 years ago
- ✓ Using scapy and nmap tools, find out ip/port, ARP SPOOFING & TCP SESSION HIJACKING ✓ Using snort tool provided Intrusion Detection Syst…☆10Oct 29, 2019Updated 6 years ago
- Reliability layer for multi-agent setups — keep agents coordinating without an orchestrator. Cross-dialog contracts + drift detection + b…☆207Updated this week
- C++ junior developer☆11Apr 5, 2026Updated 5 months ago
- RuLeanALBERT is a pretrained masked language model for the Russian language that uses a memory-efficient architecture.☆92May 27, 2023Updated 3 years ago