tinybirdco / llm-benchmarkLinks
We assessed the ability of popular LLMs to generate accurate and efficient SQL from natural language prompts. Using a 200 million record dataset from the GH Archive uploaded to Tinybird, we asked the LLMs to generate SQL based on 50 prompts.
☆59Updated last week
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- Flock: multimodal querying for DuckDB☆284Updated 2 months ago
- Deploy an AI Analyst in less than 2 mins — connect any LLM to any data source with centralized context management, observability, and con…☆320Updated this week
- A Benchmark for Real-Time Analytics Applications☆75Updated 4 months ago
- DuckDB NSQL Model☆328Updated last year
- Data management with LLMs☆176Updated 10 months ago
- Build reliable AI and agentic applications with DataFrames☆409Updated this week
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilities☆171Updated 7 months ago
- DuckDB for streaming data☆720Updated 3 months ago
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆252Updated last week
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆197Updated last month
- In-browser data analysis using SQL | Powered by duckdb-wasm☆25Updated 2 months ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆104Updated last year
- Time series forecasting with DuckDB and Evidence☆42Updated last year
- DuckLake running on top of Cloudflare Containers & R2☆168Updated last month
- Real-time deduplication and temporal joins for streaming data☆365Updated this week
- Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data type…☆63Updated 2 weeks ago
- Rust based DuckDB Server with 1st class Postgres interface for BI Tools like Power BI and Tableau. Streaming interfaces like Web, Kafka, …☆63Updated last month
- Securely run AI-generated code in stateful sandboxes that run forever.☆224Updated 7 months ago
- Firebolt Core is a free, self-hosted edition of Firebolt's distributed query engine (https://www.firebolt.io/); it provides high-performa…☆186Updated last week
- DuckDB HTTP API Server and Query Interface in a Community Extension☆258Updated this week
- Build Data Dashboards all in SQL. Powered by DuckDB.☆165Updated this week
- Duck-UI is a web-based interface for interacting with DuckDB, a high-performance analytical database system. It features a SQL editor, da…☆473Updated last week
- The open source metrics layer☆43Updated last week
- An SDK for working with LLMs and AI Agents from Apache Airflow, based on Pydantic AI☆506Updated 2 months ago
- ☆386Updated this week
- Python package for querying iceberg data through duckdb.☆70Updated last year
- Arrow Flight SQL Server☆117Updated 5 months ago
- MCP server for DuckDB and MotherDuck☆371Updated 3 weeks ago
- Iceberg Playground in a Box☆67Updated 5 months ago
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆86Updated 2 years ago