mehd-io / duckdb-pyspark-demoLinks
Demo of DuckDB Spark API implements. Same Pyspark code, but DuckDB under the hood
☆14Updated 2 years ago
Alternatives and similar repositories for duckdb-pyspark-demo
Users that are interested in duckdb-pyspark-demo are comparing it to the libraries listed below
Sorting:
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆21Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- Dask integration for Snowflake☆30Updated 5 months ago
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆108Updated this week
- Proof-of-concept extension combining the delta extension with Unity Catalog☆95Updated 3 weeks ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- A monorepo of many Rill example projects☆47Updated 3 weeks ago
- Linear regression in SQL using dbt☆75Updated 2 weeks ago
- ☆58Updated last week
- DuckDB SQL Tools add DuckDB support to VSCode, and provide database schema and SQL query interfaces for the popular SQLTools extension, S…☆19Updated last year
- IbisML is a library for building scalable ML pipelines using Ibis.☆119Updated 5 months ago
- Write your dbt models using Ibis☆74Updated 9 months ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆36Updated last year
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 3 years ago
- Build your feature store with macros right within your dbt repository☆39Updated 3 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆95Updated 10 months ago
- An experimental Athena extension for DuckDB 🐤☆57Updated last year
- ☆63Updated 8 months ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆25Updated last year
- A FastMCP tool to search and retrieve Polars API documentation.☆71Updated 7 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Updated last year
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated 2 years ago
- Jupyter Cell / Line Magics for DuckDB☆55Updated 3 months ago
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆86Updated 2 years ago
- A serverless duckDB deployment at GCP☆41Updated 3 years ago
- ☆80Updated last year
- ☆80Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year