MMLU eval for RU/EN
☆16Jul 31, 2023Updated 2 years ago
Alternatives and similar repositories for mmlu_ru
Users that are interested in mmlu_ru are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆47Jun 26, 2026Updated last week
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆63Oct 7, 2024Updated last year
- Git Hooks Tutorial.☆17Jul 6, 2022Updated 3 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- Automated machine learning for text classification☆54Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code needed to reproduce results from my ICLR 2019 paper on fixed-point quantization of the backprop algorithm.☆10Jan 24, 2019Updated 7 years ago
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆18Updated this week
- Code example for pretraining an LLM with vanilla PyTorch training loop☆10Jun 6, 2024Updated 2 years ago
- ☆22Oct 4, 2023Updated 2 years ago
- Language modeling and instruction tuning for Russian☆460Aug 20, 2024Updated last year
- Analyze a real-time IPv4 packet stream and export metrics about the data flows☆14Jan 29, 2020Updated 6 years ago
- Estimate Your LLM's Token Toll Across Various Platforms and Configurations☆39Nov 9, 2025Updated 7 months ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆158May 22, 2024Updated 2 years ago
- Tools and scripts for experimenting with Transformers: Bert, T5...☆61Jan 6, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Vulnerability Knowledge Base comparison tool☆13Feb 9, 2022Updated 4 years ago
- ☆14Jan 17, 2024Updated 2 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆167Dec 8, 2025Updated 6 months ago
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆13Mar 24, 2024Updated 2 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogue☆33Jan 4, 2023Updated 3 years ago
- ☆11Nov 5, 2021Updated 4 years ago
- Many things I've done with different programming languages☆14Aug 26, 2020Updated 5 years ago
- Excel MCP Server - Manipulate Excel files without Microsoft Excel. Model Context Protocol for XLSX, XLSM with Claude AI integration☆32Jun 18, 2025Updated last year
- f("A1") = 𓀀; also A1.png☆12Jun 4, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Intersection Over Union☆15Nov 26, 2017Updated 8 years ago
- Russian paraphrasers. Generate paraphrases with mt5, gpt2, etc.☆56May 27, 2023Updated 3 years ago
- ☆11Dec 11, 2024Updated last year
- A graphical sound editor which uses CSCore library for reading and playing sound files.☆11Jul 27, 2016Updated 9 years ago
- notes on applied computer security☆11Jun 27, 2023Updated 3 years ago
- RUSSE 2022: Russian Text Detoxification Based on Parallel Corpora☆20Apr 2, 2025Updated last year
- Pipeline for fast building text classification TF-IDF + LogReg baselines.☆61Nov 6, 2021Updated 4 years ago
- 4-bit quantization of models using GPTQ☆18Mar 6, 2023Updated 3 years ago
- Open source multimodal OpenLKA dataset☆19Feb 13, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 3 years ago
- a collection of tools and python libraries for use in medical practice and research☆12Nov 22, 2025Updated 7 months ago
- ☆18Apr 28, 2022Updated 4 years ago
- Generate questions based on text in Russian☆27Apr 7, 2021Updated 5 years ago
- ☆11Dec 9, 2020Updated 5 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- [ICLR 2026] Official code of "Segment any Events with Language"☆49Apr 10, 2026Updated 2 months ago