Alternatives and similar repositories for CIMA

Users that are interested in CIMA are comparing it to the libraries listed below

• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆116Updated 6 months ago
• ThomasScialom / QuestEval
  ☆100Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆102Updated 8 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• google-research / dialog-inpainting
  ☆97Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Updated 4 years ago
• salesforce / QAFactEval
  ☆51Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 2 months ago
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆74Updated 2 years ago
• MicrosoftTranslator / GEMBA
  GEMBA — GPT Estimation Metric Based Assessment
  ☆127Updated last year
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆145Updated 2 years ago
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆56Updated 3 years ago
• google / wmt-mqm-human-evaluation
  ☆92Updated 2 weeks ago
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆137Updated 2 years ago
• velocityCavalry / CREPE
  An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"
  ☆16Updated 11 months ago
• dapascual / K2T
  ☆71Updated 3 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆104Updated 4 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆104Updated last year
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆59Updated 2 years ago
• katherinethai / par3
  ☆28Updated 10 months ago
• shauryr / ACL-anthology-corpus
  This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs
  ☆184Updated last year
• orhonovich / q-squared
  ☆30Updated 4 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• tagoyal / factuality-datasets
  ☆46Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• McGill-NLP / FaithDial
  ☆50Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆80Updated 6 years ago
• eth-nlped / mathdial
  🧮 MathDial: A Dialog Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems, EMNLP Findings 2023
  ☆64Updated 3 weeks ago
• allenai / PRIMER
  The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization
  ☆156Updated 2 years ago