Alternatives and similar repositories for calibration_metric

Users that are interested in calibration_metric are comparing it to the libraries listed below

• microsoft / semantic_parsing_with_constrained_lm
  Code to reproduce experiments in the paper "Constrained Language Models Yield Few-Shot Semantic Parsers" (EMNLP 2021).
  ☆68Updated last year
• dallascard / NLP-power-analysis
  Replication code for "With Little Power Comes Great Responsibility"
  ☆39Updated 5 years ago
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆140Updated 8 months ago
• viking-sudo-rm / rusty-dawg
  Rust library for indexing and quickly searching large pretraining corpora
  ☆30Updated last month
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• epfl-dlab / GCD
  ☆44Updated 8 months ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 3 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• benlipkin / decoding
  Composable inference algorithms with LLMs and programmable logic
  ☆69Updated 11 months ago
• wellecks / naturalproofs
  NaturalProofs: Mathematical Theorem Proving in Natural Language (NeurIPS 2021 Datasets & Benchmarks)
  ☆133Updated 3 years ago
• nyu-mll / quality
  ☆142Updated 10 months ago
• shmsw25 / bart-closed-book-qa
  A BART version of an open-domain QA model in a closed-book setup
  ☆119Updated 5 years ago
• john-hewitt / truncation-sampling
  Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
  ☆13Updated 2 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆42Updated 2 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• allenai / Lila
  A unified benchmark for math reasoning
  ☆89Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• princeton-nlp / NLProofS
  EMNLP 2022: Generating Natural Language Proofs with Verifier-Guided Search https://arxiv.org/abs/2205.12443
  ☆86Updated last year
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆24Updated 2 years ago
• MSR-LIT / Splash
  Release of SPLASH: Dataset for semantic parse correction with natural language feedback in the context of text-to-SQL parsing
  ☆42Updated 5 years ago
• krishnap25 / mauve-experiments
  ☆38Updated last year
• LogiTorch / logitorch
  LogiTorch is a PyTorch-based library for logical reasoning on natural language
  ☆73Updated last month
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated last month
• google-research / dialog-inpainting
  ☆97Updated 3 years ago
• rrmenon10 / ExEnt
  [ACL 2022] CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations
  ☆10Updated 3 years ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆43Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• qkaren / unsup_gen_for_cms_reasoning
  ☆49Updated 2 years ago