VikhrModels / ru_llm_arena
Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language
☆39Updated 3 weeks ago
Alternatives and similar repositories for ru_llm_arena:
Users that are interested in ru_llm_arena are comparing it to the libraries listed below
- Effective LLM Alignment Toolkit☆125Updated this week
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆62Updated 6 months ago
- ☆31Updated 6 months ago
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆61Updated last year
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆25Updated 2 weeks ago
- Простой нормализатор текстов перед синтезом речи☆29Updated 11 months ago
- Telegram bot for different language models. Supports system prompts and images☆45Updated 4 months ago
- Top ML papers of the week.☆30Updated this week
- ☆26Updated this week
- Augmentex — a library for augmenting texts with errors☆63Updated 9 months ago
- ☆22Updated last year
- Репозиторий измеряет качество Yandexgpt, Gigachat, T-Pro, Saiga, Vikhr, Ruadapt на популярных англоязычных бенчмарках: MGSM, MATH, HumanE…☆23Updated 2 weeks ago
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆29Updated last month
- ☆46Updated last month
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆151Updated 3 months ago
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆17Updated 2 months ago
- AI-generated text boundary detection with RoFT☆24Updated 7 months ago
- "Руформеры" - список популярных базовых моделей на основе трансформеров для решения задач по автоматической обработке русского языка☆36Updated last year
- This project is concerned with my participating in the RuNNE competition https://github.com/dialogue-evaluation/RuNNE☆12Updated last year
- Enterprise RAG Challenge to test accuracy of different LLM-driven assistants☆49Updated last week
- Evalica, your favourite evaluation toolkit☆33Updated last week
- ☆26Updated last month
- Bunch of notebooks for pre-training custom Saiga-like LLM☆13Updated last year
- GigaChain telegram bot example for technical support☆30Updated 3 months ago
- ☆12Updated last year
- Framework for processing and filtering datasets☆27Updated 8 months ago
- A new second practical assignment for Huawei's NLP course☆17Updated last year
- The tiniest sentence encoder for Russian language☆218Updated 8 months ago
- RAG pipeline implementation example for the Russian language☆22Updated last year
- Проект языковой модели для проведения морфемного анализа, сегментации и токенизации слов русского языка.☆15Updated 3 months ago