Alternatives and similar repositories for evalica

Users that are interested in evalica are comparing it to the libraries listed below

• VikhrModels / mctslib
  ☆31Updated 8 months ago
• VikhrModels / effective_llm_alignment
  Effective LLM Alignment Toolkit
  ☆131Updated 3 weeks ago
• VikhrModels / ru_llm_arena
  Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language
  ☆42Updated 2 months ago
• ai-forever / fbc3_aij2023
  ☆22Updated last year
• ai-forever / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…
  ☆62Updated 7 months ago
• whitecircle-ai / circle-guard-bench
  First-of-its-kind AI benchmark for evaluating the protection capabilities of large language model (LLM) guard systems (guardrails and saf…
  ☆37Updated 3 weeks ago
• cene555 / ru-clip-tiny
  RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).
  ☆33Updated 2 years ago
• ai-forever / DataProcessingFramework
  Framework for processing and filtering datasets
  ☆27Updated 10 months ago
• ai-forever / sage
  SAGE: Spelling correction, corruption and evaluation for multiple languages
  ☆153Updated 5 months ago
• averkij / top_papers
  Top ML papers of the week.
  ☆31Updated this week
• ai-forever / augmentex
  Augmentex — a library for augmenting texts with errors
  ☆64Updated 11 months ago
• kuk / rulm-sbs2
  Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat
  ☆61Updated last year
• dayyass / muse_tf2pt
  Convert MUSE from TensorFlow to PyTorch and ONNX
  ☆11Updated last year
• IlyaGusev / gazeta
  Gazeta: Dataset for automatic summarization of Russian news / Газета: набор данных для автоматического реферирования на русском языке
  ☆35Updated 3 years ago
• ai-forever / LIBRA
  ☆18Updated 2 months ago
• EvilFreelancer / saiga-custom
  Bunch of notebooks for pre-training custom Saiga-like LLM
  ☆13Updated last year
• RussianNLP / rutransform
  RuTransform: python framework for adversarial attacks and text data augmentation for Russian
  ☆19Updated last year
• MERA-Evaluation / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…
  ☆25Updated 2 months ago
• bond005 / runne_contrastive_ner
  This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE
  ☆12Updated last year
• kuk / simple-evals-ru
  Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…
  ☆23Updated last month
• tatiana-iazykova / bert-for-sequence-classification
  Pipeline for easy fine-tuning of BERT architecture for sequence classification
  ☆23Updated last year
• AlexWortega / ruImageCaptioning
  ☆17Updated 3 years ago
• RussianNLP / RuBLiMP
  RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
  ☆17Updated 3 months ago
• dayyass / rllib
  Reinforcement Learning Library.
  ☆28Updated 2 years ago
• Nemexur / revisit-bpr
  Repository for the paper: "Revisiting BPR: A Replicability Study of a Common Recommender System Baseline"
  ☆52Updated 6 months ago
• ai-forever / ru-prompts
  ☆57Updated last year
• NLP-Core-Team / mmlu_ru
  MMLU eval for RU/EN
  ☆15Updated last year
• mts-ai / rurage
  ☆31Updated last month
• IlyaGusev / saiga
  ☆46Updated last month
• PgLoLo / optiacts
  ☆20Updated 10 months ago