Alternatives and similar repositories for calibration_metric

Users that are interested in calibration_metric are comparing it to the libraries listed below

• huggingface / that_is_good_data
  ☆66Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• microsoft / semantic_parsing_with_constrained_lm
  Code to reproduce experiments in the paper "Constrained Language Models Yield Few-Shot Semantic Parsers" (EMNLP 2021).
  ☆64Updated last year
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆42Updated 2 years ago
• viking-sudo-rm / rusty-dawg
  Rust library for indexing and quickly searching large pretraining corpora
  ☆27Updated this week
• google-research / t5x_retrieval
  ☆101Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆66Updated 2 years ago
• ThomasScialom / QuestEval
  ☆99Updated last year
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆276Updated 2 years ago
• oriram / spider
  ☆54Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• yanaiela / pararel
  ☆45Updated last year
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago
• google-deepmind / streamingqa
  ☆48Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• dallascard / NLP-power-analysis
  Replication code for "With Little Power Comes Great Responsibility"
  ☆39Updated 4 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆54Updated 2 years ago
• tomhosking / hercules
  Hercules: Attributable and Scalable Opinion Summarization (ACL 2023)
  ☆21Updated last year
• google-research / dialog-inpainting
  ☆97Updated 3 years ago
• princeton-nlp / NLProofS
  EMNLP 2022: Generating Natural Language Proofs with Verifier-Guided Search https://arxiv.org/abs/2205.12443
  ☆86Updated 10 months ago
• sebastian-hofstaetter / colberter
  ☆46Updated 3 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆144Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 3 weeks ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 2 years ago
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆139Updated 5 months ago
• ritikamangla / QSalience
  https://arxiv.org/abs/2404.10917
  ☆14Updated 4 months ago
• john-hewitt / truncation-sampling
  Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
  ☆12Updated 2 years ago