tinybirdco / llm-benchmarkLinks
We assessed the ability of popular LLMs to generate accurate and efficient SQL from natural language prompts. Using a 200 million record dataset from the GH Archive uploaded to Tinybird, we asked the LLMs to generate SQL based on 50 prompts.
☆52Updated this week
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- Flock: multimodal querying for DuckDB☆275Updated last month
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilities☆166Updated 5 months ago
- Data management with LLMs☆173Updated 9 months ago
- In-browser data analysis using SQL | Powered by duckdb-wasm☆25Updated last month
- MCP server for DuckDB and MotherDuck☆355Updated last week
- DuckDB NSQL Model☆321Updated last year
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆192Updated this week
- A Benchmark for Real-Time Analytics Applications☆73Updated 3 months ago
- DuckDB for streaming data☆635Updated last month
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆86Updated 2 years ago
- Build reliable AI and agentic applications with DataFrames☆364Updated this week
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆104Updated last year
- An SDK for working with LLMs and AI Agents from Apache Airflow, based on Pydantic AI☆486Updated 3 weeks ago
- Time series forecasting with DuckDB and Evidence☆42Updated 11 months ago
- Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data type…☆60Updated this week
- SQL Reimagined for the Modern Data World☆49Updated this week
- Python package for querying iceberg data through duckdb.☆70Updated last year
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆232Updated this week
- DuckDB CronJob Extension☆41Updated last month
- DuckLake running on top of Cloudflare Containers & R2☆159Updated last week
- Rust based DuckDB Server with 1st class Postgres interface for BI Tools like Power BI and Tableau. Streaming interfaces like Web, Kafka, …☆54Updated last week
- ☆370Updated last week
- A playground for running duckdb as a stateless query engine over a data lake☆211Updated last year
- DuckDB API Server with Arrow Flight SQL Airport support and concurrent writes/reads (quackpipe)☆105Updated 7 months ago
- 🚀 GizmoSQL — High-Performance SQL Server☆199Updated this week
- DuckDB extension allowing shell commands to be used for input and output.☆82Updated this week
- An example of how to run DuckDB on AWS Lambda & API Gateway.☆209Updated 4 months ago
- Real-time deduplication and temporal joins for streaming data☆349Updated this week
- Iceberg Playground in a Box☆67Updated 3 months ago
- Deploy an AI Analyst in less than 2 mins — connect any LLM to any data source with centralized context management, observability, and con…☆190Updated this week