Alternatives and similar repositories for GlotEval

Users that are interested in GlotEval are comparing it to the libraries listed below

• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• cisnlp / MEXA
  🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
  ☆11Updated 3 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated last year
• UKPLab / acl2024-triple-encoders
  triple-encoders is a library for contextualizing distributed Sentence Transformers representations.
  ☆14Updated 10 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 11 months ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆127Updated 10 months ago
• MicrosoftTranslator / GEMBA
  GEMBA — GPT Estimation Metric Based Assessment
  ☆119Updated 11 months ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆32Updated last month
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆98Updated 2 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• google-research / metricx
  ☆102Updated 7 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆57Updated last year
• huggingface / that_is_good_data
  ☆66Updated last year
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆99Updated 3 weeks ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆131Updated last year
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆66Updated 5 months ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• masakhane-io / masakhane-news
  MasakhaNEWS: News Topic Classification for African Languages
  ☆23Updated last year
• BatsResearch / LexC-Gen
  Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
  ☆16Updated 9 months ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆85Updated last month
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆21Updated 2 years ago
• dmg-illc / JUDGE-BENCH
  ☆30Updated last month
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆110Updated 4 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated 11 months ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆82Updated 10 months ago
• malteos / clp-transfer
  Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
  ☆30Updated 2 years ago
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆21Updated 5 months ago
• lm-pub-quiz / lm-pub-quiz
  Evaluate language models using multiple choice items
  ☆13Updated 2 months ago