mehd-io / duckdb-pyspark-demoLinks
Demo of DuckDB Spark API implements. Same Pyspark code, but DuckDB under the hood
☆14Updated last year
Alternatives and similar repositories for duckdb-pyspark-demo
Users that are interested in duckdb-pyspark-demo are comparing it to the libraries listed below
Sorting:
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆20Updated last year
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆25Updated last year
- Dask integration for Snowflake☆30Updated 3 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆117Updated 3 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- ☆55Updated last month
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆104Updated last week
- Proof-of-concept extension combining the delta extension with Unity Catalog☆91Updated last month
- ☆80Updated 2 years ago
- ☆90Updated last year
- Linear regression in SQL using dbt☆75Updated 9 months ago
- Python package for querying iceberg data through duckdb.☆70Updated last year
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆26Updated last year
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- Write your dbt models using Ibis☆72Updated 7 months ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆88Updated 8 months ago
- An experimental Athena extension for DuckDB 🐤☆57Updated 10 months ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- ☆34Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆58Updated 5 months ago
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated 2 years ago
- A monorepo of many Rill example projects☆45Updated last week
- A FastMCP tool to search and retrieve Polars API documentation.☆71Updated 5 months ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- Jupyter Cell / Line Magics for DuckDB☆54Updated 3 weeks ago
- ☆60Updated 6 months ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- A playground for running duckdb as a stateless query engine over a data lake☆212Updated last year
- A DuckDB extension to read data directly from databases supporting the ODBC interface☆86Updated 2 years ago