Alternatives and similar repositories for TestSuiteEval:

Users that are interested in TestSuiteEval are comparing it to the libraries listed below

• WING-NUS / slsql
  Code for the EMNLP 2020 paper "Re-examining the Role of Schema Linking in Text-to-SQL".
  ☆28Updated 4 years ago
• ygan / Spider-Syn
  ☆17Updated 3 years ago
• tzshi / squall
  Data and Code Release for "On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queries"
  ☆51Updated 4 years ago
• taoyds / grappa
  ☆31Updated 3 years ago
• ServiceNow / duorat
  DuoRAT is a ServiceNow Research project that was started at Element AI.
  ☆56Updated last year
• vzhong / gazp
  Source code for Grounded Adaptation for Zero-shot Executable Semantic Parsing
  ☆21Updated 4 years ago
• microsoft / HiTab
  [ACL 2022] A hierarchical table dataset for question answering and data-to-text generation.
  ☆80Updated last month
• MSR-LIT / Splash
  Release of SPLASH: Dataset for semantic parse correction with natural language feedback in the context of text-to-SQL parsing
  ☆42Updated 4 years ago
• leuchine / self_play_picard
  Using self-play to augment multi-turn text-to-SQL datasets
  ☆11Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆77Updated 11 months ago
• awslabs / diagnostic-robustness-text-to-sql
  Data for paper "Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness"
  ☆32Updated last year
• microsoft / compositional-generalization-span-level-attention
  code for the NAACL 2021 paper Compositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention by Microsoft S…
  ☆11Updated last year
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• UKPLab / SciGen
  ☆16Updated 3 years ago
• TIGER-AI-Lab / TableCoT
  The code and data for paper "Large Language Models are few(1)-shot Table Reasoners" [EACL2023]
  ☆46Updated 10 months ago
• XinyuanLu00 / SciTab
  The project page for "SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables"
  ☆19Updated last year
• yszh8 / TriageSQL
  The dataset and source code for our paper: "Did You Ask a Good Question? A Cross-Domain Question IntentionClassification Benchmark for Te…
  ☆31Updated 3 years ago
• Muennighoff / FLAN
  Provides a minimal implementation to extract FLAN datasets for further processing
  ☆11Updated 2 years ago
• dnaihao / text-to-SQL-survey
  ☆30Updated last year
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated last year
• sunlab-osu / MISP
  Model-based Interactive Semantic Parsing (MISP) framework
  ☆53Updated 7 months ago
• microsoft / text-to-sql-schema-expansion-generalization
  Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion
  ☆13Updated last year
• inbaroren / improving-compgen-in-semparse
  ☆17Updated 4 years ago
• sunlab-osu / Understanding-CoT
  ☆86Updated last year
• Chia-Hsuan-Lee / KaggleDBQA
  Introduction page of a challenging text-to-SQL dataset: KaggleDBQA
  ☆35Updated last year
• yanaiela / pararel
  ☆44Updated last year
• zorazrw / multilingual-conala
  [EACL'23] MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages
  ☆23Updated 2 years ago
• FranxYao / Complexity-Based-Prompting
  Complexity Based Prompting for Multi-Step Reasoning
  ☆17Updated 2 years ago
• microsoft / SCoRE
  ICLR 2021: Pre-Training for Context Representation in Conversational Semantic Parsing
  ☆30Updated 3 years ago
• Yale-LILY / LoFT
  Code for EACL 2023 paper "LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Control"
  ☆20Updated 2 years ago