NLP-Core-Team / mmlu_ru
MMLU eval for RU/EN
☆14Updated last year
Related projects: ⓘ
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆57Updated this week
- MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker☆21Updated last year
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆13Updated 2 months ago
- ☆12Updated 2 years ago
- ☆58Updated 7 months ago
- Russian dialog datasets parsers and crawlers.☆15Updated 3 years ago
- Framework for processing and filtering datasets☆25Updated last month
- ☆15Updated 2 weeks ago
- Augmentex — a library for augmenting texts with errors☆48Updated 2 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆15Updated 2 weeks ago
- Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.☆126Updated 2 years ago
- Russian Artificial Text Detection☆17Updated 2 years ago
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆45Updated 3 weeks ago
- Pipeline for easy fine-tuning of BERT architecture for sequence classification☆22Updated last year
- Train punctuation and capitalization models for different languages☆24Updated 2 years ago
- Russian Corpus of Linguistic Acceptability☆40Updated last year
- This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE☆10Updated last year
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆129Updated last month
- Probing suite for evaluation of Russian embedding and language models☆32Updated 2 years ago
- BSNLP 2021☆32Updated 2 years ago
- ☆29Updated last year
- ☆17Updated 3 years ago
- Question answering on russian with XLMRobertaLarge as a service☆21Updated 2 years ago
- RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).☆32Updated 2 years ago
- A Russian data set for question answering over Wikidata☆46Updated 3 years ago
- ☆18Updated last year
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Updated 2 years ago
- A small library with distillation, quantization and pruning pipelines☆26Updated 3 years ago
- ☆21Updated 11 months ago
- FusionBrain Challenge 2.0: creating multimodal multitask model☆16Updated last year