awslabs / unified-text2sql-benchmark
UNITE: A Unified Benchmark for Text-to-SQL Evaluation
☆57Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for unified-text2sql-benchmark
- [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".☆113Updated 5 months ago
- The prediction results of ChatGPT on various datasets of Text-to-SQL.☆99Updated last year
- Using Large Language Models (LLMs) to convert natural language queries to sql☆39Updated 3 weeks ago
- Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Scaling Natural Language Querying to Massive Databases"☆56Updated last month
- This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".☆99Updated 2 weeks ago
- Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows☆117Updated this week
- Introduction page of a challenging text-to-SQL dataset: KaggleDBQA☆33Updated last year
- Contextual Harnessing for Efficient SQL Synthesis☆110Updated 2 months ago
- The code for the paper C3: Zero-shot Text-to-SQL with ChatGPT☆118Updated 3 months ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆127Updated 2 weeks ago
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets☆124Updated 7 months ago
- This repository contains all the code for the DTS-SQL paper☆40Updated 3 months ago
- Semantic Evaluation for Text-to-SQL with Distilled Test Suites☆224Updated 5 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆239Updated last year
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆43Updated 10 months ago
- ☆325Updated 7 months ago
- [ACL24] Official repo for "Synthesizing Text-to-SQL Data from Weak and Strong LLMs"☆60Updated 3 months ago
- AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆104Updated 3 weeks ago
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆131Updated 10 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆337Updated last week
- YuLan-IR: Information Retrieval Boosted LMs☆214Updated 8 months ago
- Official repository for the paper “The Dawn of Natural Language to SQL: Are We Fully Ready?” (VLDB'24)☆74Updated last month
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆114Updated last month
- MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL☆192Updated 4 months ago
- [EMNLP 2023 Findings] ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought☆16Updated 9 months ago
- Benchmark baseline for retrieval qa applications☆95Updated 6 months ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆92Updated last month
- ☆124Updated 8 months ago
- Foundation Models for Data Tasks☆100Updated last year
- Numbers Station Text to SQL model code.☆231Updated last year