Alternatives and similar repositories for QATCH:

Users that are interested in QATCH are comparing it to the libraries listed below

• alirezamshi / RQUGE
  The implementation of "RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question" [ACL 2023]
  ☆16Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆127Updated last year
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆412Updated 5 months ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• UKPLab / gpl
  Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …
  ☆333Updated last year
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆463Updated last year
• jinlanfu / GPTScore
  Source Code of Paper "GPTScore: Evaluate as You Desire"
  ☆246Updated 2 years ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆123Updated 8 months ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆198Updated last year
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆48Updated 2 years ago
• g8a9 / ferret
  A python package for benchmarking interpretability techniques on Transformers.
  ☆212Updated 6 months ago
• Babelscape / FENICE
  FENICE (Factuality Evaluation of Summarization based on Natural Language Inference and Claim Extraction) is a factuality-oriented metric …
  ☆18Updated 4 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• SapienzaNLP / maverick-coref
  ☆49Updated last week
• peterbaile / beaver
  🦫 BEAVER: An Enterprise Benchmark for Text-to-SQL
  ☆16Updated last month
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆104Updated last year
• universal-ner / universal-ner
  ☆360Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆340Updated last week
• asahi417 / lmppl
  Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …
  ☆155Updated 6 months ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆199Updated 2 years ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆190Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆68Updated last year
• realtimeqa / realtimeqa_public
  ☆73Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆91Updated 2 months ago
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆137Updated 4 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆180Updated 3 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆292Updated last month
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆170Updated 4 months ago