NLP-Core-Team / mmlu_ru
MMLU eval for RU/EN
☆15Updated last year
Alternatives and similar repositories for mmlu_ru:
Users that are interested in mmlu_ru are comparing it to the libraries listed below
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆17Updated last month
- Russian Artificial Text Detection☆18Updated 2 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆20Updated 4 months ago
- ☆12Updated 2 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆62Updated 5 months ago
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Updated last month
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆22Updated 2 years ago
- ☆29Updated 2 years ago
- Russian dialog datasets parsers and crawlers.☆16Updated 3 years ago
- Probing suite for evaluation of Russian embedding and language models☆33Updated 5 months ago
- ☆17Updated 3 months ago
- Pipeline for easy fine-tuning of BERT architecture for sequence classification☆22Updated last year
- RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).☆32Updated 2 years ago
- ☆57Updated last year
- Augmentex — a library for augmenting texts with errors☆62Updated 8 months ago
- This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE☆11Updated last year
- ☆18Updated 3 years ago
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆47Updated last month
- Russian Corpus of Linguistic Acceptability☆42Updated 5 months ago
- Framework for probing tasks☆25Updated 11 months ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆150Updated 2 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆38Updated 3 months ago
- Punctuation and casing restoration for the Russian Language (BERT-based)☆20Updated 3 years ago
- Top ML papers of the week.☆25Updated this week
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆60Updated last year
- A Russian data set for question answering over Wikidata☆47Updated 3 years ago
- Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.☆66Updated 2 years ago
- Framework for processing and filtering datasets☆27Updated 7 months ago
- ☆23Updated 3 years ago