Alternatives and similar repositories for LLM-Evaluation:

Users that are interested in LLM-Evaluation are comparing it to the libraries listed below

• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• salesforce / QAFactEval
  ☆45Updated 2 years ago
• yanaiela / pararel
  ☆44Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆89Updated 2 months ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆54Updated 2 years ago
• AlexWan0 / rag-convincingness
  ☆25Updated last year
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• mcao516 / EntFA
  ☆25Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆22Updated 2 weeks ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆21Updated 2 weeks ago
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆62Updated 2 years ago
• realtimeqa / realtimeqa_public
  ☆73Updated last year
• balevinstein / Probes
  ☆47Updated last year
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆20Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 2 years ago
• xiye17 / TextualExplInContext
  The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning (NeurIPS 2022)
  ☆14Updated 2 years ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 3 weeks ago
• teacherpeterpan / ProgramFC
  Codes for ACL 2023 Paper "Fact-Checking Complex Claims with Program-Guided Reasoning"
  ☆30Updated last year
• yasumasaonoe / entity_knowledge_propagation
  ☆16Updated last year
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated last year
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆13Updated last year
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆100Updated 2 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆58Updated last year
• XinyuanLu00 / QACheck
  About Data and Codes for EMNLP 2023 System Demo Paper "QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checking"
  ☆18Updated last year
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• WadeYin9712 / GeoMLAMA
  ☆14Updated 2 years ago