Alternatives and similar repositories for mlmm-evaluation:

Users that are interested in mlmm-evaluation are comparing it to the libraries listed below

• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆95Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆218Updated 5 months ago
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆100Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆68Updated last year
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆139Updated 6 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 8 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆90Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆171Updated 5 months ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• nyu-mll / quality
  ☆133Updated 3 months ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆56Updated 8 months ago
• RUCAIBox / Language-Specific-Neurons
  ☆74Updated 4 months ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆81Updated last year
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆250Updated last year
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆198Updated last year
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆87Updated 6 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated 2 years ago
• qinyiwei / InfoBench
  ☆53Updated 8 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆127Updated last year
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆101Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆79Updated last month
• SALT-NLP / CultureBank
  ☆41Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆124Updated 10 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆107Updated 3 weeks ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆127Updated 3 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆123Updated 11 months ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆93Updated 3 months ago