Alternatives and similar repositories for mlmm-evaluation:

Users that are interested in mlmm-evaluation are comparing it to the libraries listed below

• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆200Updated 2 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆92Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆124Updated 10 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆99Updated 8 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• AlexTMallen / adaptive-retrieval
  ☆173Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆67Updated 10 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆83Updated 2 months ago
• nyu-mll / quality
  ☆124Updated this week
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• RUCAIBox / Language-Specific-Neurons
  ☆57Updated 3 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆129Updated 2 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆82Updated 5 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆132Updated last month
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆99Updated 2 years ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆195Updated 11 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆57Updated last year
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆201Updated 3 months ago
• realtimeqa / realtimeqa_public
  ☆70Updated 11 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆119Updated 10 months ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆70Updated 3 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆87Updated 2 weeks ago
• SALT-NLP / CultureBank
  ☆40Updated 8 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆75Updated 9 months ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆24Updated 3 weeks ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆111Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆73Updated last month
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago