Alternatives and similar repositories for MalayMMLU:

Users that are interested in MalayMMLU are comparing it to the libraries listed below

• mesolitica / malaysian-dataset
  We gather Malaysian dataset! https://malaysian-dataset.readthedocs.io/
  ☆315Updated this week
• mesolitica / malaya
  Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/
  ☆488Updated this week
• SEACrowd / seacrowd-datahub
  A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.
  ☆81Updated 3 months ago
• malaysia-ai / dataset
  Recipes to prepare datasets!
  ☆13Updated last month
• DAMO-NLP-SG / DAMO-SeaLLMs
  [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
  ☆166Updated 8 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆108Updated 2 months ago
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆77Updated 3 weeks ago
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆65Updated 2 months ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 3 weeks ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆61Updated last year
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated 7 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆100Updated last year
• ali-bahrainian / RAG_best_practices
  ☆90Updated last month
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆127Updated 4 months ago
• BatsResearch / LexC-Gen
  Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
  ☆15Updated 6 months ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆59Updated 6 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• mznmel / Pico-Saudi-LLMs-Benchmark
  أسئلة باللغة العربية تركز على الثقافة السعودية تم اختبارها على عدد من النماذج اللغوية الضخمة LLMs
  ☆14Updated 3 months ago
• mesolitica / malaya-speech
  Speech Toolkit for Malaysian language, https://malaya-speech.readthedocs.io/
  ☆251Updated last week
• mbzuai-oryx / LLMVoX
  LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM
  ☆240Updated last month
• sail-sg / sailor-llm
  [EMNLP-2024] ⚓️ Sailor: Open Language Models for South-East Asia
  ☆129Updated 4 months ago
• yuxiaw / OpenFactCheck
  ☆43Updated 10 months ago
• keyreply / Malay-NLP-Dataset
  A collection of NLP resources for Malay
  ☆25Updated 6 years ago
• hetpandya / paraphrase-datasets-pretrained-models
  A collection of preprocessed datasets and pretrained models for generating paraphrases.
  ☆29Updated 3 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆102Updated 5 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated 2 months ago
• mbzuai-nlp / ArabicMMLU
  ☆25Updated 7 months ago
• menloresearch / ReZero
  ☆121Updated last week
• uds-lsv / afro-maft
  ☆17Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆83Updated 10 months ago