Alternatives and similar repositories for LLMeBench

Users that are interested in LLMeBench are comparing it to the libraries listed below

• primeqa / clapnq
  ☆41Updated 5 months ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆69Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆124Updated 10 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆129Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆101Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated this week
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆185Updated 6 months ago
• yuxiaw / OpenFactCheck
  ☆51Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆84Updated 10 months ago
• asahi417 / lm-vocab-trimmer
  Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…
  ☆40Updated 8 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆128Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆97Updated 2 months ago
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆79Updated last month
• guyfe / Tweetsumm
  A dataset focused on summarization of dialogs, which represents the rich domain of Twitter customer care conversations
  ☆32Updated last year
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆114Updated 2 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆96Updated 4 months ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆105Updated 7 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆104Updated 2 years ago
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆44Updated 8 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆90Updated last year
• abhika-m / FAVA
  ☆71Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 10 months ago
• dmg-illc / JUDGE-BENCH
  ☆27Updated 3 weeks ago
• viswavi / few-shot-clustering
  ☆76Updated 8 months ago
• kstats / CIMA
  ☆22Updated 3 years ago
• google-research-datasets / seegull
  SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…
  ☆35Updated last year