tinybirdco / llm-benchmarkLinks
We assessed the ability of popular LLMs to generate accurate and efficient SQL from natural language prompts. Using a 200 million record dataset from the GH Archive uploaded to Tinybird, we asked the LLMs to generate SQL based on 50 prompts.
☆67Updated this week
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- Flock: multimodal querying for DuckDB☆288Updated last month
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilities☆171Updated 8 months ago
- DuckDB NSQL Model☆331Updated last year
- In-browser data analysis using SQL | Powered by duckdb-wasm☆26Updated 3 weeks ago
- A Benchmark for Real-Time Analytics Applications☆79Updated 6 months ago
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆201Updated 3 months ago
- Generate BM25 sparse vector inside PostgreSQL☆91Updated last year
- Unified local observability for AI coding assistants☆149Updated 2 weeks ago
- Real-time deduplication and temporal joins for streaming data☆397Updated this week
- Declarative context engineering for agents☆433Updated last week
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆105Updated last year
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆299Updated this week
- DuckLake running on top of Cloudflare Containers & R2☆173Updated 3 months ago
- Time series forecasting with DuckDB and Evidence☆43Updated last year
- DuckDB HTTP API Server and Query Interface in a Community Extension☆263Updated last month
- A DuckDB extension for graph data analytics☆108Updated this week
- Data management with LLMs☆180Updated 11 months ago
- Chat with your data - with memory, rules, and observability built in. Deploy in 2 minutes☆403Updated last week
- MCP server for DuckDB and MotherDuck☆394Updated last week
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆132Updated 11 months ago
- DuckDB extension allowing shell commands to be used for input and output.☆91Updated last month
- Securely run AI-generated code in stateful sandboxes that run forever.☆224Updated 9 months ago
- DuckDB for streaming data☆742Updated 4 months ago
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆84Updated 2 years ago
- Marmot helps teams discover, understand, and leverage their data with powerful search and lineage visualisation tools. It's designed to m…☆490Updated last week
- RAG based agent with chDB(ClickHouse)☆22Updated 8 months ago
- Running DuckDB behind a Hono.js API☆92Updated 6 months ago
- Build complete API integrations with YAML and SQL. Rapid development without vendor lock-in and per-row costs.☆88Updated 7 months ago
- DuckDB-powered analytics in Postgres☆153Updated last year
- An example of how to run DuckDB on AWS Lambda & API Gateway.☆216Updated 7 months ago