Alternatives and similar repositories for MalayMMLU

Users that are interested in MalayMMLU are comparing it to the libraries listed below

• malaysia-ai / malaya
  Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/
  ☆521Updated last week
• malaysia-ai / malaysian-dataset
  We gather Malaysian dataset! https://malaysian-dataset.readthedocs.io/
  ☆328Updated 3 weeks ago
• SEACrowd / seacrowd-datahub
  A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.
  ☆94Updated last year
• aisingapore / sealion
  South-East Asia Large Language Models
  ☆383Updated this week
• flairNLP / transformer-ranker
  Efficiently find the best-suited language model (LM) for your NLP task
  ☆134Updated 6 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆425Updated last month
• s-smits / modernbert-finetune
  Fine-tune ModernBERT with custom tokenizers, curriculum learning, and next-gen optimizers.
  ☆74Updated 2 weeks ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆559Updated 4 months ago
• FreedomIntelligence / AceGPT
  ☆127Updated last year
• mindscapexyz / Sarjana
  Sarjana is an open source desktop application which is used to assist in reading information materials, be it research papers or technica…
  ☆24Updated last year
• agfianf / fastapi-RED-metrics
  implement RED metrics in fastapi integrate with Prometheus and Grafana
  ☆40Updated 11 months ago
• indonesian-nlp / multilingual-asr
  Multilingual Speech Recognition for Indonesian Languages
  ☆70Updated 3 years ago
• ahmedheakl / arazn-llm
  Code-Switched translations with Large Language models
  ☆24Updated last year
• MinishLab / semhash
  Fast Multimodal Semantic Deduplication & Filtering
  ☆877Updated last week
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆186Updated 2 months ago
• NVIDIA-NeMo / DataDesigner
  🎨 NeMo Data Designer: A general library for generating high-quality synthetic data from scratch or based on seed data.
  ☆654Updated last week
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆90Updated 6 months ago
• DAMO-NLP-SG / DAMO-SeaLLMs
  [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
  ☆173Updated last year
• facebookresearch / SONAR
  SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.
  ☆858Updated 3 months ago
• meta-llama / synthetic-data-kit
  Tool for generating high quality Synthetic datasets
  ☆1,476Updated 3 months ago
• MohamedAliRashad / arabic-nougat
  Code for Arabic Nougat
  ☆50Updated last year
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆340Updated last year
• CohleM / lilLM
  A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.
  ☆55Updated 9 months ago
• MinishLab / model2vec
  Fast State-of-the-Art Static Embeddings
  ☆1,990Updated last month
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆305Updated 8 months ago
• AI4Privacy / LLM_STATUS_CODES
  ☆56Updated last year
• fajri91 / sum_liputan6
  The first large-scale summarization corpus for the Indonesian language. AACL 2020.
  ☆38Updated 4 years ago
• rayliuca / T-Ragx
  Enhancing Translation with RAG-Powered Large Language Models
  ☆89Updated last month
• UBC-NLP / peacock
  This is the official repository for Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks.
  ☆26Updated last year
• ARBML / CIDAR
  Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.
  ☆43Updated 9 months ago