Alternatives and similar repositories for TestSuiteEval:

Users that are interested in TestSuiteEval are comparing it to the libraries listed below

• ygan / Spider-Syn
  ☆17Updated 3 years ago
• tzshi / squall
  Data and Code Release for "On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queries"
  ☆52Updated 4 years ago
• WING-NUS / slsql
  Code for the EMNLP 2020 paper "Re-examining the Role of Schema Linking in Text-to-SQL".
  ☆28Updated 4 years ago
• taoyds / grappa
  ☆31Updated 3 years ago
• vzhong / gazp
  Source code for Grounded Adaptation for Zero-shot Executable Semantic Parsing
  ☆21Updated 4 years ago
• ServiceNow / duorat
  DuoRAT is a ServiceNow Research project that was started at Element AI.
  ☆56Updated last year
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated last year
• tomerwolgithub / Break
  ☆45Updated 2 years ago
• pcyin / zeroshot_parser
  A zero-shot neural semantic parser without using annotated parallel training data.
  ☆9Updated 2 years ago
• matt-seb-ho / WikiWhy
  WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…
  ☆47Updated last year
• microsoft / compositional-generalization-span-level-attention
  code for the NAACL 2021 paper Compositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention by Microsoft S…
  ☆11Updated last year
• inbaroren / improving-compgen-in-semparse
  ☆17Updated 4 years ago
• microsoft / text-to-sql-schema-expansion-generalization
  Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion
  ☆13Updated last year
• microsoft / HiTab
  [ACL 2022] A hierarchical table dataset for question answering and data-to-text generation.
  ☆77Updated last week
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated last year
• sunlab-osu / Understanding-CoT
  ☆85Updated last year
• THU-BPM / ISESL-SQL
  The source code of paper "Semantic Enhanced Text-to-SQL Parsing via Iteratively Learning Schema Linking Graph" in KDD2022.
  ☆14Updated 2 years ago
• MSR-LIT / Splash
  Release of SPLASH: Dataset for semantic parse correction with natural language feedback in the context of text-to-SQL parsing
  ☆42Updated 4 years ago
• zorazrw / multilingual-conala
  [EACL'23] MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages
  ☆23Updated 2 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated last year
• yszh8 / TriageSQL
  The dataset and source code for our paper: "Did You Ask a Good Question? A Cross-Domain Question IntentionClassification Benchmark for Te…
  ☆32Updated 3 years ago
• Mayer123 / UDT-QA
  Code for the paper "Open Domain Question Answering with A Unified Knowledge Interface" (ACL 2022)
  ☆57Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆75Updated 2 months ago
• yasufumy / spider-schema-linking-dataset
  ☆14Updated 3 years ago
• UKPLab / SciGen
  ☆16Updated 3 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆77Updated 10 months ago
• wenhuchen / TableCoT
  The code and data used for EACL2023 Paper: "Large Language Models are few(1)-shot Table Reasoners"
  ☆41Updated 9 months ago
• liujch1998 / rainier
  ☆28Updated 11 months ago
• yanaiela / pararel
  ☆44Updated last year
• dnaihao / text-to-SQL-survey
  ☆30Updated last year