CLARIN-PL / chatgpt-evaluation-01-2023
Code, datasets and results of the ChatGPT evaluation presented in paper "ChatGPT: Jack of all trades, master of none"
☆29Updated 2 years ago
Alternatives and similar repositories for chatgpt-evaluation-01-2023:
Users that are interested in chatgpt-evaluation-01-2023 are comparing it to the libraries listed below
- TBC☆26Updated 2 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Updated 2 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 7 months ago
- This repository contains the code for "How many data points is a prompt worth?"☆48Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Updated 2 years ago
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated 2 years ago
- Perturbation CheckLists for Evaluating NLG Evaluation Metrics, EMNLP 2021☆9Updated 3 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 3 years ago
- Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021☆29Updated 2 years ago
- Unifew: Unified Fewshot Learning Model☆18Updated 3 years ago
- This is the repository for COLING 2022 paper "Context-Tuning: Learning Contextualized Prompts for Natural Language Generation".☆11Updated 2 years ago
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆53Updated last year
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆48Updated last year
- ☆54Updated 2 years ago
- A benchmark dataset for evaluating dialog system and natural language generation metrics.☆36Updated 2 years ago
- Website for release of TellMeWhy dataset for why question answering☆14Updated 2 years ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆76Updated last week
- An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation☆27Updated 9 months ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆59Updated last month
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆77Updated 11 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆76Updated last year
- ☆44Updated 6 months ago
- ☆25Updated 2 years ago
- Code for the ACL2022 paper "Synthetic Question Value Estimation for Domain Adaptation of Question Answering"☆17Updated 3 years ago
- ☆19Updated last year
- Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22☆18Updated last year
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆83Updated last year
- Code for paper 'Data-Efficient FineTuning'☆29Updated last year
- ☆38Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated 2 years ago