Alternatives and similar repositories for mmlu_ru

Users that are interested in mmlu_ru are comparing it to the libraries listed below

• s-nlp / russe_detox_2022
  RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora
  ☆20Updated 7 months ago
• ai-forever / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…
  ☆62Updated last year
• s-nlp / mutual_implication_score
  ☆12Updated 3 years ago
• RussianNLP / RuBLiMP
  RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
  ☆19Updated 9 months ago
• LAIR-RCC / ruadapt
  ☆13Updated last year
• ai-forever / sage
  SAGE: Spelling correction, corruption and evaluation for multiple languages
  ☆162Updated 11 months ago
• ai-forever / augmentex
  Augmentex — a library for augmenting texts with errors
  ☆68Updated last year
• VikhrModels / effective_llm_alignment
  Effective LLM Alignment Toolkit
  ☆148Updated 4 months ago
• dialogue-evaluation / RuATD
  Russian Artificial Text Detection
  ☆18Updated 3 years ago
• MERA-Evaluation / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…
  ☆36Updated last month
• ai-forever / LIBRA
  ☆18Updated 7 months ago
• RussianNLP / MOROCCO
  MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker
  ☆23Updated 3 years ago
• tatiana-iazykova / bert-for-sequence-classification
  Pipeline for easy fine-tuning of BERT architecture for sequence classification
  ☆23Updated 2 years ago
• ai-forever / mgpt
  Multilingual Generative Pretrained Model
  ☆207Updated last year
• kuk / simple-evals-ru
  Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…
  ☆24Updated 7 months ago
• VikhrModels / ru_llm_arena
  Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language
  ☆45Updated 7 months ago
• RussianNLP / RuCoLA
  Russian Corpus of Linguistic Acceptability
  ☆48Updated last year
• averkij / top_papers
  Top ML papers of the week.
  ☆41Updated 2 weeks ago
• RussianNLP / RussianSuperGLUE
  Russian SuperGLUE benchmark
  ☆112Updated 2 years ago
• cene555 / ru-clip-tiny
  RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).
  ☆35Updated 3 years ago
• RussianNLP / RuSentEval
  Probing suite for evaluation of Russian embedding and language models
  ☆33Updated last year
• s-nlp / rudetoxifier
  Code and data of "Methods for Detoxification of Texts for the Russian Language" paper
  ☆49Updated 7 months ago
• kuk / rulm-sbs2
  Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat
  ☆60Updated 2 years ago
• dayyass / QaNER
  Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.
  ☆65Updated 3 years ago
• ai-forever / ru-prompts
  ☆57Updated last year
• alexeykarnachev / dialogs_data_parsers
  Russian dialog datasets parsers and crawlers.
  ☆16Updated 4 years ago
• RussianNLP / russian_paraphrasers
  Russian paraphrasers. Generate paraphrases with mt5, gpt2, etc.
  ☆54Updated 2 years ago
• vdobrovolskii / rucoco
  ☆30Updated 2 years ago
• AlekseyKorshuk / optimum-transformers
  Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
  ☆126Updated 3 years ago
• prohor33 / qa-roberta-ru-saas
  Question answering on russian with XLMRobertaLarge as a service
  ☆21Updated 4 years ago