mehd-io / duckdb-pyspark-demoLinks
Demo of DuckDB Spark API implements. Same Pyspark code, but DuckDB under the hood
☆14Updated last year
Alternatives and similar repositories for duckdb-pyspark-demo
Users that are interested in duckdb-pyspark-demo are comparing it to the libraries listed below
Sorting:
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆17Updated last year
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆57Updated 2 years ago
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆26Updated last year
- Linear regression in SQL using dbt☆71Updated 6 months ago
- A serverless duckDB deployment at GCP☆40Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆55Updated 2 months ago
- A FastMCP tool to search and retrieve Polars API documentation.☆66Updated 2 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆114Updated last week
- DuckDB SQL Tools add DuckDB support to VSCode, and provide database schema and SQL query interfaces for the popular SQLTools extension, S…☆17Updated last year
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆34Updated 8 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆26Updated last year
- rust-for-data☆45Updated 2 years ago
- Build your feature store with macros right within your dbt repository☆39Updated 2 years ago
- Proof-of-concept extension combining the delta extension with Unity Catalog☆89Updated last month
- Fake Pandas / PySpark DataFrame creator☆47Updated last year
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆24Updated last year
- Full stack data engineering tools and infrastructure set-up☆55Updated 4 years ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Dask integration for Snowflake☆30Updated this week
- Write your dbt models using Ibis☆69Updated 4 months ago
- ☆11Updated 8 months ago
- Utility functions for dbt projects running on Spark☆33Updated 5 months ago
- Jupyter Cell / Line Magics for DuckDB☆51Updated last month
- A monorepo of many Rill example projects☆42Updated last week
- Read Delta tables without any Spark☆47Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆52Updated 9 months ago
- A repository of runnable examples using ibis☆44Updated last year
- ☆53Updated 2 weeks ago