Alternatives and similar repositories for evalica:

Users that are interested in evalica are comparing it to the libraries listed below

• VikhrModels / mctslib
  ☆31Updated 6 months ago
• VikhrModels / ru_llm_arena
  Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language
  ☆39Updated last week
• VikhrModels / effective_llm_alignment
  Effective LLM Alignment Toolkit
  ☆123Updated 2 weeks ago
• ai-forever / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…
  ☆62Updated 5 months ago
• kuk / rulm-sbs2
  Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat
  ☆61Updated last year
• RussianNLP / RuBLiMP
  RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
  ☆17Updated last month
• cene555 / ru-clip-tiny
  RuCLIP tiny (Russian Contrastive Language–Image Pretraining) is a neural network trained to work with different pairs (images, texts).
  ☆32Updated 2 years ago
• ai-forever / augmentex
  Augmentex — a library for augmenting texts with errors
  ☆63Updated 8 months ago
• ai-forever / fbc3_aij2023
  ☆22Updated last year
• ai-forever / sage
  SAGE: Spelling correction, corruption and evaluation for multiple languages
  ☆150Updated 3 months ago
• MERA-Evaluation / MERA
  MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…
  ☆20Updated 4 months ago
• ai-forever / DataProcessingFramework
  Framework for processing and filtering datasets
  ☆27Updated 7 months ago
• dayyass / muse_tf2pt
  Convert MUSE from TensorFlow to PyTorch and ONNX
  ☆11Updated 10 months ago
• averkij / top_papers
  Top ML papers of the week.
  ☆25Updated this week
• LAIR-RCC / ruadapt
  ☆11Updated last year
• ai-forever / LIBRA
  ☆18Updated 3 months ago
• IlyaGusev / holosophos
  ☆26Updated this week
• kuk / simple-evals-ru
  Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…
  ☆21Updated last week
• SilverSolver / ai_boundary_detection
  AI-generated text boundary detection with RoFT
  ☆24Updated 6 months ago
• EvilFreelancer / saiga-custom
  Bunch of notebooks for pre-training custom Saiga-like LLM
  ☆13Updated last year
• VikhrModels / Salt
  ☆39Updated 2 weeks ago
• IlyaGusev / saiga
  ☆43Updated 2 weeks ago
• RussianNLP / rutransform
  RuTransform: python framework for adversarial attacks and text data augmentation for Russian
  ☆19Updated last year
• trustbit / enterprise-rag-challenge
  Enterprise RAG Challenge to test accuracy of different LLM-driven assistants
  ☆48Updated last week
• PgLoLo / optiacts
  ☆20Updated 8 months ago
• mts-ai / rurage
  ☆26Updated 3 weeks ago
• EvilFreelancer / impruver
  A set of scripts and configurations for pretraining of Large Language Models (LLM)
  ☆28Updated 3 weeks ago
• Nemexur / revisit-bpr
  Repository for the paper: "Revisiting BPR: A Replicability Study of a Common Recommender System Baseline"
  ☆50Updated 4 months ago
• corl-team / rebased
  Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"
  ☆159Updated 2 months ago
• NLP-Core-Team / mmlu_ru
  MMLU eval for RU/EN
  ☆15Updated last year