HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.
☆38Oct 15, 2024Updated last year
Alternatives and similar repositories for hanna-benchmark-asg
Users that are interested in hanna-benchmark-asg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- Benchmark for evaluating open-ended generation☆50Nov 6, 2024Updated last year
- The official repository for our EMNLP 2024 paper, Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretab…☆21Feb 23, 2025Updated last year
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆49Jan 21, 2025Updated last year
- ☆41Jun 7, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆35Jan 7, 2026Updated 6 months ago
- Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…☆50Dec 8, 2022Updated 3 years ago
- Personalized Story Evaluation Model☆17Nov 27, 2023Updated 2 years ago
- [ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"☆46Jul 19, 2024Updated 2 years ago
- What are the best Systems? New Perspectives on NLP Benchmarking☆13Mar 16, 2023Updated 3 years ago
- NLG evaluation via Statistical Measures of Similarity: BaryScore, DepthScore, InfoLM☆39Dec 27, 2022Updated 3 years ago
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 3 years ago
- ☆23Feb 26, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The official repo for "CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models"☆35Mar 26, 2026Updated 4 months ago
- ☆19Oct 8, 2024Updated last year
- Pre-training Intent-Aware Encoders for Zero- and Few-Shot Intent Classification☆17Jan 8, 2024Updated 2 years ago
- ☆21Jan 15, 2024Updated 2 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆368Jun 27, 2022Updated 4 years ago
- Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)☆33Jun 6, 2022Updated 4 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆217Feb 10, 2024Updated 2 years ago
- ☆35Jun 12, 2022Updated 4 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆415Jun 23, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- Cleaned up version of the PlotMachines code☆68Jun 12, 2023Updated 3 years ago
- UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation☆59Oct 13, 2020Updated 5 years ago
- Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue (ACL Findings 2023)☆21Nov 10, 2025Updated 8 months ago
- Implementation for paper "A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation"☆102Dec 25, 2019Updated 6 years ago
- ☆14Aug 9, 2024Updated last year
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models☆60Nov 26, 2024Updated last year
- ☆10Jan 28, 2024Updated 2 years ago
- Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Textual Style Transfer☆36Oct 2, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Apr 16, 2025Updated last year
- ☆13Oct 28, 2020Updated 5 years ago
- ☆14Apr 23, 2025Updated last year
- papper,overview,☆15Jul 22, 2024Updated 2 years ago
- Deep Learning Seminar -- ÚFAL course NPFL117☆17Nov 22, 2022Updated 3 years ago
- Data Valuation on In-Context Examples (ACL23)☆24Jan 12, 2025Updated last year
- The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…☆27Nov 13, 2023Updated 2 years ago