mehd-io / duckdb-pyspark-demoLinks
Demo of DuckDB Spark API implements. Same Pyspark code, but DuckDB under the hood
☆14Updated 2 years ago
Alternatives and similar repositories for duckdb-pyspark-demo
Users that are interested in duckdb-pyspark-demo are comparing it to the libraries listed below
Sorting:
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆21Updated 2 years ago
- Dask integration for Snowflake☆30Updated 4 months ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆119Updated 4 months ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Read Delta tables without any Spark☆47Updated last year
- Linear regression in SQL using dbt☆75Updated 11 months ago
- A python library bakeoff for medium sized datasets☆24Updated 2 years ago
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆107Updated this week
- Python package for querying iceberg data through duckdb.☆70Updated last year
- ☆80Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆25Updated last year
- Build your feature store with macros right within your dbt repository☆39Updated 3 years ago
- DuckDB SQL Tools add DuckDB support to VSCode, and provide database schema and SQL query interfaces for the popular SQLTools extension, S…☆19Updated last year
- Proof-of-concept extension combining the delta extension with Unity Catalog☆94Updated 2 weeks ago
- A FastMCP tool to search and retrieve Polars API documentation.☆71Updated 6 months ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 3 years ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Updated last year
- lakefs-samples repository☆87Updated last week
- ☆62Updated 7 months ago
- An experimental Athena extension for DuckDB 🐤☆57Updated 11 months ago
- SQLMesh example projects☆37Updated 5 months ago
- ☆57Updated last month
- A monorepo of many Rill example projects☆45Updated last week
- Write your dbt models using Ibis☆74Updated 9 months ago
- A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino☆93Updated 2 weeks ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆229Updated last week