tinybirdco / llm-benchmarkLinks
We assessed the ability of popular LLMs to generate accurate and efficient SQL from natural language prompts. Using a 200 million record dataset from the GH Archive uploaded to Tinybird, we asked the LLMs to generate SQL based on 50 prompts.
☆36Updated last week
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- FlockMTL: DuckDB extension to seamlessly combine analytics and semantic analysis using language models (LMs)☆218Updated last week
- DuckDB Community Extension to prompt LLMs from SQL☆48Updated 4 months ago
- A Higher-Level, Composable SQL☆44Updated this week
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆183Updated last week
- Postgres extensions to support end-to-end Retrieval-Augmented Generation (RAG) pipelines☆81Updated 3 weeks ago
- Time series forecasting with DuckDB and Evidence☆39Updated 7 months ago
- Fast similarity search using DuckDB☆133Updated 7 months ago
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilities☆116Updated 3 weeks ago
- ☆90Updated last year
- An example of how to run DuckDB on AWS Lambda & API Gateway.☆149Updated 2 months ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆97Updated 7 months ago
- MCP server for DuckDB and MotherDuck☆170Updated last week
- Sord Data Fabric: A Vue 3 frontend with a Python WebSocket server, leveraging a distributed architecture with DeltaLake and DuckDB worker…☆18Updated last year
- CLI to create an ER Diagram from DuckDB database files☆122Updated 2 months ago
- DuckDB NSQL Model☆298Updated 7 months ago
- Running DuckDB behind a Hono.js API☆67Updated 2 weeks ago
- An in-process Parquet merge engine for better data warehousing in S3 with MVCC☆146Updated this week
- API Framework heavily relying on the power of DuckDB and DuckDB extensions. Ready to build performant and cost-efficient APIs on top of B…☆28Updated last week
- DuckDB extension allowing shell commands to be used for input and output.☆70Updated last month
- A Benchmark for Real-Time Analytics Applications☆64Updated last month
- DuckDB Cron Expression Extension☆25Updated 11 months ago
- DuckDB HTTP API Server and Query Interface in a Community Extension☆202Updated last month
- S3 vector database for LLM Agents and RAG.☆39Updated last year
- Python package for querying iceberg data through duckdb.☆68Updated last year
- ☆280Updated this week
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆79Updated 3 months ago
- Ask questions, let GPT do the SQL.☆132Updated 2 years ago
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆86Updated last year
- Official Python API client library for turbopuffer☆51Updated this week
- Securely run AI-generated code in stateful sandboxes that run forever.☆195Updated last month