Alternatives and similar repositories for calibration_metric

Users that are interested in calibration_metric are comparing it to the libraries listed below

• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 9 months ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆66Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• yanaiela / pararel
  ☆44Updated last year
• jacobandreas / geca
  ☆42Updated 4 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• dallascard / NLP-power-analysis
  ☆39Updated 4 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆76Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• allenai / Break
  ☆84Updated 2 years ago
• tomerwolgithub / Break
  ☆46Updated 2 years ago
• alontalmor / LeapOfThought
  ☆49Updated last year
• Yale-LILY / ROSE
  ☆38Updated 2 years ago
• d223302 / LLM-Evaluation
  Can Large Language Models Be an Alternative to Human Evaluations?
  ☆9Updated last year
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆27Updated 3 years ago
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆143Updated 2 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆96Updated 2 years ago
• StonyBrookNLP / teabreac
  Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22
  ☆19Updated last year
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆139Updated 3 months ago
• tomhosking / hercules
  Hercules: Attributable and Scalable Opinion Summarization (ACL 2023)
  ☆21Updated last year
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 3 years ago