Alternatives and similar repositories for LLM-Evaluation

Users that are interested in LLM-Evaluation are comparing it to the libraries listed below

• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆23Updated 2 months ago
• salesforce / QAFactEval
  ☆48Updated 2 years ago
• tsor13 / kaleido
  ☆22Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆24Updated 2 months ago
• Yixiao-Song / VeriScore
  ☆20Updated 5 months ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆94Updated 4 months ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• LanD-FBK / benchmark-gen-explanations
  Codes for "Benchmarking the Generation of Fact Checking Explanations"
  ☆10Updated 9 months ago
• yanaiela / pararel
  ☆44Updated last year
• mcao516 / EntFA
  ☆26Updated 2 years ago
• WadeYin9712 / GeoMLAMA
  ☆15Updated 2 years ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆55Updated 2 years ago
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• AlexWan0 / rag-convincingness
  ☆27Updated last year
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆80Updated 4 years ago
• hover-nlp / hover
  ☆17Updated 4 years ago
• matt-seb-ho / WikiWhy
  WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…
  ☆47Updated last year
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆21Updated 2 years ago
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆62Updated 2 years ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 3 months ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• balevinstein / Probes
  ☆50Updated last year
• ellaneeman / disent_qa
  This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.
  ☆17Updated 2 years ago
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆14Updated last year
• velocityCavalry / CREPE
  An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"
  ☆16Updated 7 months ago