Alternatives and similar repositories for TestSuiteEval:

Users that are interested in TestSuiteEval are comparing it to the libraries listed below

• WING-NUS / slsql
  Code for the EMNLP 2020 paper "Re-examining the Role of Schema Linking in Text-to-SQL".
  ☆28Updated 4 years ago
• tzshi / squall
  Data and Code Release for "On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queries"
  ☆52Updated 4 years ago
• ygan / Spider-Syn
  ☆17Updated 3 years ago
• taoyds / grappa
  ☆31Updated 3 years ago
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated last year
• vzhong / gazp
  Source code for Grounded Adaptation for Zero-shot Executable Semantic Parsing
  ☆21Updated 4 years ago
• awslabs / diagnostic-robustness-text-to-sql
  Data for paper "Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness"
  ☆32Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• MSR-LIT / Splash
  Release of SPLASH: Dataset for semantic parse correction with natural language feedback in the context of text-to-SQL parsing
  ☆42Updated 4 years ago
• ServiceNow / duorat
  DuoRAT is a ServiceNow Research project that was started at Element AI.
  ☆57Updated last year
• inbaroren / improving-compgen-in-semparse
  ☆17Updated 4 years ago
• awslabs / gap-text2sql
  GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
  ☆104Updated last year
• UKPLab / SciGen
  ☆18Updated 3 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆79Updated last month
• dnaihao / text-to-SQL-survey
  ☆30Updated last year
• allenai / DecomP
  Repository for Decomposed Prompting
  ☆90Updated last year
• microsoft / text-to-sql-schema-expansion-generalization
  Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion
  ☆13Updated last year
• sunlab-osu / Understanding-CoT
  ☆86Updated last year
• microsoft / HiTab
  [ACL 2022] A hierarchical table dataset for question answering and data-to-text generation.
  ☆84Updated last month
• TIGER-AI-Lab / TableCoT
  The code and data for paper "Large Language Models are few(1)-shot Table Reasoners" [EACL2023]
  ☆46Updated last year
• Yale-LILY / FeTaQA
  Dataset for TACL 2022 paper: "FeTaQA: Free-form Table Question Answering"
  ☆80Updated last year
• yszh8 / TriageSQL
  The dataset and source code for our paper: "Did You Ask a Good Question? A Cross-Domain Question IntentionClassification Benchmark for Te…
  ☆31Updated 3 years ago
• microsoft / compositional-generalization-span-level-attention
  code for the NAACL 2021 paper Compositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention by Microsoft S…
  ☆11Updated 2 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated 2 years ago
• headacheboy / IGSQL
  ☆28Updated 4 years ago
• ygan / NatSQL
  ☆46Updated 2 years ago
• rajasagashe / JuICe
  Code for generating the JuICe dataset.
  ☆37Updated 3 years ago
• DevSinghSachan / emdr2
  Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…
  ☆109Updated 3 years ago
• Mayer123 / UDT-QA
  Code for the paper "Open Domain Question Answering with A Unified Knowledge Interface" (ACL 2022)
  ☆57Updated last year