Alternatives and similar repositories for LLMeBench

Users that are interested in LLMeBench are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆103Updated last week
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• viswavi / few-shot-clustering
  ☆79Updated last year
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆114Updated 2 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆153Updated last year
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆170Updated 11 months ago
• primeqa / clapnq
  ☆42Updated 8 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆86Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆61Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆104Updated 2 years ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• google-research-datasets / Attributed-QA
  We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in …
  ☆54Updated 2 years ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆101Updated 8 months ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆50Updated last year
• kasnerz / tabgenie
  A multi-purpose toolkit for table-to-text generation: web interface, Python bindings, CLI commands.
  ☆56Updated last year
• awslabs / rag-qa-arena
  ☆48Updated last year
• yuxiaw / Factcheck-GPT
  Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.
  ☆105Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆98Updated 10 months ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆131Updated last year
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago
• dmg-illc / JUDGE-BENCH
  ☆35Updated 2 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆203Updated 10 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• HumanSignal / RLHF
  Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…
  ☆222Updated 2 years ago