Alternatives and similar repositories for LLM-Evaluation

Users that are interested in LLM-Evaluation are comparing it to the libraries listed below

• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• yanaiela / pararel
  ☆44Updated last year
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆23Updated 3 months ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• salesforce / QAFactEval
  ☆48Updated 2 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆21Updated 2 years ago
• mcao516 / EntFA
  ☆26Updated 2 years ago
• AlexWan0 / rag-convincingness
  ☆27Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆96Updated 4 months ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆56Updated 2 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated last year
• GXimingLu / a_star_neurologic
  ☆43Updated 2 years ago
• WadeYin9712 / GeoMLAMA
  ☆15Updated 2 years ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆24Updated 3 months ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 3 months ago
• Yale-LILY / ROSE
  ☆39Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆77Updated 6 years ago
• realtimeqa / realtimeqa_public
  ☆75Updated last year
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆80Updated 4 years ago
• Yixiao-Song / VeriScore
  ☆21Updated 6 months ago
• tsor13 / kaleido
  ☆22Updated last year
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆100Updated 2 years ago
• beinborn / relative_importance
  ☆17Updated last week
• matt-seb-ho / WikiWhy
  WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…
  ☆47Updated last year