Alternatives and similar repositories for LLMeBench:

Users that are interested in LLMeBench are comparing it to the libraries listed below

• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆99Updated 8 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆124Updated 10 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆93Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆67Updated 10 months ago
• primeqa / clapnq
  ☆37Updated 6 months ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 2 years ago
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆60Updated 2 years ago
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆77Updated last month
• adapter-hub / efficient-task-transfer
  Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021
  ☆34Updated 3 years ago
• salesforce / QAFactEval
  ☆44Updated last year
• IBM / kgi-slot-filling
  This is the code for our KILT leaderboard submissions (KGI + Re2G models).
  ☆152Updated last year
• yzjiao / On-Demand-IE
  Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction
  ☆50Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆115Updated 4 months ago
• yuxiaw / OpenFactCheck
  ☆38Updated 7 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆147Updated 2 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆142Updated 8 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆200Updated 2 months ago
• Yale-LILY / ConvoSumm
  ☆37Updated 2 years ago
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆22Updated last year
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆75Updated 9 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆82Updated 5 months ago
• r-three / fib
  ☆26Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆73Updated 2 months ago
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆106Updated 2 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆32Updated 3 months ago
• kwang2049 / easy-elasticsearch
  Using business-level retrieval system (BM25) with Python in just a few lines.
  ☆31Updated last year
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆97Updated last year
• LogiTorch / logitorch
  LogiTorch is a PyTorch-based library for logical reasoning on natural language
  ☆70Updated 4 months ago