Alternatives and similar repositories for Multi-Prompt-LLM-Evaluation

Users that are interested in Multi-Prompt-LLM-Evaluation are comparing it to the libraries listed below

• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆12Updated 2 months ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• dmis-lab / TouR
  Findings of ACL'2023: Optimizing Test-Time Query Representations for Dense Retrieval
  ☆30Updated last year
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆32Updated 11 months ago
• mikejqzhang / SituatedQA
  ☆21Updated 2 years ago
• swj0419 / kNN_prompt
  TBC
  ☆27Updated 2 years ago
• jaehunjung1 / Maieutic-Prompting
  ☆50Updated last year
• INK-USC / ReCross
  ReCross: Unsupervised Cross-Task Generalization via Retrieval Augmentation
  ☆24Updated 3 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆24Updated 2 months ago
• swarnaHub / SummarizationPrograms
  [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees
  ☆24Updated last year
• kaistAI / knowledge-reasoning
  [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…
  ☆21Updated 6 months ago
• XinyuanLu00 / SciTab
  The project page for "SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables"
  ☆20Updated last year
• AkariAsai / evidentiality_qa
  The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).
  ☆43Updated 2 years ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆22Updated 10 months ago
• jwallat / knowledge-probing
  Code for our BlackboxNLP'20 paper "BERTnesia: Investigating the capture and forgetting of knowledge in BERT"
  ☆9Updated 3 years ago
• Tiiiger / templm
  Code release for "TempLM: Distilling Language Models into Template-Based Generators"
  ☆14Updated 2 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆28Updated 8 months ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• peterbhase / LAS-NL-Explanations
  Code for paper "Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?"
  ☆21Updated 4 years ago
• xiangyue9607 / QVE
  Code for the ACL2022 paper "Synthetic Question Value Estimation for Domain Adaptation of Question Answering"
  ☆17Updated 3 years ago
• claws-lab / XLingEval
  Code and Resources for the paper, "Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries"
  ☆16Updated last year
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• swarnaHub / ExplaGraphs
  [EMNLP 2021] Dataset and PyTorch Code for ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning
  ☆11Updated 2 years ago
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• allenai / few_shot_explanations
  Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"
  ☆31Updated 2 years ago