Alternatives and similar repositories for mmlu_ru:

Users that are interested in mmlu_ru are comparing it to the libraries listed below

• RussianNLP / RuBLiMP
  RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
  ☆17Updated last month
• MERA-Evaluation / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…
  ☆20Updated 4 months ago
• dialogue-evaluation / RuATD
  Russian Artificial Text Detection
  ☆18Updated 2 years ago
• ai-forever / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…
  ☆62Updated 5 months ago
• s-nlp / mutual_implication_score
  ☆12Updated 2 years ago
• s-nlp / russe_detox_2022
  RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora
  ☆20Updated last month
• RussianNLP / MOROCCO
  MOdel ResOurCe COnsumption. Evaluate Russian SuperGLUE models performance: inference speed, RAM usage. Reproducible scores using Docker
  ☆22Updated 2 years ago
• tatiana-iazykova / bert-for-sequence-classification
  Pipeline for easy fine-tuning of BERT architecture for sequence classification
  ☆22Updated last year
• cene555 / ru-clip-tiny
  RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).
  ☆32Updated 2 years ago
• averkij / top_papers
  Top ML papers of the week.
  ☆25Updated this week
• alexeykarnachev / dialogs_data_parsers
  Russian dialog datasets parsers and crawlers.
  ☆16Updated 3 years ago
• ai-forever / DataProcessingFramework
  Framework for processing and filtering datasets
  ☆27Updated 7 months ago
• s-nlp / rudetoxifier
  Code and data of "Methods for Detoxification of Texts for the Russian Language" paper
  ☆47Updated last month
• RussianNLP / RuSentEval
  Probing suite for evaluation of Russian embedding and language models
  ☆33Updated 5 months ago
• ai-forever / LIBRA
  ☆17Updated 3 months ago
• ai-forever / augmentex
  Augmentex — a library for augmenting texts with errors
  ☆62Updated 8 months ago
• vdobrovolskii / rucoco
  ☆29Updated 2 years ago
• VikhrModels / ru_llm_arena
  Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language
  ☆38Updated 3 months ago
• ai-forever / ru-prompts
  ☆56Updated last year
• RussianNLP / rutransform
  RuTransform: python framework for adversarial attacks and text data augmentation for Russian
  ☆19Updated last year
• vladislavneon / RuBQ
  A Russian data set for question answering over Wikidata
  ☆47Updated 3 years ago
• oKatanaaa / kolibrify
  Curriculum training of instruction-following LLMs with Unsloth
  ☆14Updated 2 weeks ago
• RussianNLP / RuCoLA
  Russian Corpus of Linguistic Acceptability
  ☆42Updated 5 months ago
• VikhrModels / effective_llm_alignment
  Effective LLM Alignment Toolkit
  ☆121Updated this week
• averkij / multipunct
  Train punctuation and capitalization models for different languages
  ☆24Updated 2 years ago
• vaskonov / burvec
  Word Embeddings for Low Resource Languages: The Case of Buryat
  ☆10Updated last year
• nerel-ds / NEREL
  NEREL: A Russian Dataset with Nested Named Entities, Relations and Events
  ☆27Updated last year
• ai-forever / fbc2_aij2022
  FusionBrain Challenge 2.0: creating multimodal multitask model
  ☆16Updated 2 years ago