tinybirdco / llm-benchmarkLinks
We assessed the ability of popular LLMs to generate accurate and efficient SQL from natural language prompts. Using a 200 million record dataset from the GH Archive uploaded to Tinybird, we asked the LLMs to generate SQL based on 50 prompts.
☆44Updated 2 weeks ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- FlockMTL: DuckDB extension for multimodal querying using language models (LMs) and retrieval augmented generation (RAG)☆261Updated last week
- A Benchmark for Real-Time Analytics Applications☆70Updated last month
- DuckDB NSQL Model☆310Updated 10 months ago
- DuckDB for streaming data☆612Updated 2 months ago
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆189Updated last week
- Data management with LLMs☆170Updated 7 months ago
- DuckDB HTTP API Server and Query Interface in a Community Extension☆224Updated 2 weeks ago
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilities☆150Updated 3 months ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆101Updated 10 months ago
- Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data type…☆57Updated last week
- Build reliable AI and agentic applications with DataFrames☆238Updated this week
- A Higher-Level, Composable SQL☆46Updated this week
- Postgres extensions to support end-to-end Retrieval-Augmented Generation (RAG) pipelines☆83Updated this week
- A Python framework for defining and querying BI models in your data warehouse☆169Updated 7 months ago
- An SDK for working with LLMs and AI Agents from Apache Airflow, based on Pydantic AI☆470Updated last week
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆84Updated last year
- DuckDB-powered analytics in Postgres☆152Updated last year
- Python package for querying iceberg data through duckdb.☆70Updated last year
- DuckDB extension allowing shell commands to be used for input and output.☆79Updated 2 months ago
- Generate BM25 sparse vector inside PostgreSQL☆83Updated 9 months ago
- GigAPI is a Timeseries lakehouse for real-time data and sub-second queries, powered by DuckDB OLAP + Parquet Query Engine, Compactor w/ C…☆329Updated this week
- API Framework heavily relying on the power of DuckDB and DuckDB extensions. Ready to build performant and cost-efficient APIs on top of B…☆43Updated 2 months ago
- Securely run AI-generated code in stateful sandboxes that run forever.☆217Updated 4 months ago
- MCP server for DuckDB and MotherDuck☆310Updated last week
- ☆334Updated 2 weeks ago
- An example of how to run DuckDB on AWS Lambda & API Gateway.☆180Updated 2 months ago
- Real-time deduplication and temporal joins for streaming data☆321Updated last week
- ☆90Updated last year
- Fast similarity search using DuckDB☆140Updated 9 months ago
- Sord Data Fabric: A Vue 3 frontend with a Python WebSocket server, leveraging a distributed architecture with DeltaLake and DuckDB worker…☆18Updated last year