MERA-Evaluation / MERA
MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA models.
☆11Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for MERA
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆58Updated last month
- Effective LLM Alignment Toolkit☆85Updated last week
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆57Updated last year
- Top ML papers of the week.☆20Updated this week
- AI-generated text boundary detection with RoFT☆22Updated 2 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆24Updated 2 weeks ago
- MMLU eval for RU/EN☆14Updated last year
- Telegram bot for different language models. Supports system prompts and images☆37Updated 2 weeks ago
- Framework for processing and filtering datasets☆25Updated 3 months ago
- ☆26Updated last month
- Bunch of notebooks for pre-training custom Saiga-like LLM☆13Updated 9 months ago
- RuLeanALBERT is a pretrained masked language model for the Russian language that uses a memory-efficient architecture.☆92Updated last year
- Augmentex — a library for augmenting texts with errors☆51Updated 4 months ago
- Enterprise RAG Challenge to test accuracy of different LLM-driven assistants☆29Updated 2 months ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆131Updated last month
- ☆21Updated last year
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆14Updated last month
- ☆53Updated last month
- Universal LLM Telegram chatbot in Python☆13Updated 2 months ago
- "Руформеры" - список популярных базовых моделей на основе трансформеров для решения задач по автоматической обработке русского языка☆36Updated 11 months ago
- ☆30Updated last week
- T5-based (russian) text normalization☆19Updated 9 months ago
- LangChain-compatible integrations with YandexGPT and YandexGPT Embeddings☆35Updated 2 weeks ago
- Примеры продвинутого RAG☆28Updated last month
- ☆14Updated last year
- Простой нормализатор текстов перед синтезом речи☆20Updated 5 months ago
- ☆58Updated 9 months ago
- Russian Corpus of Linguistic Acceptability☆41Updated last month
- Convert MUSE from TensorFlow to PyTorch and ONNX☆11Updated 5 months ago