edgBR / delta-lake-polars
Building a poor man's data lake: Exploring the Power of Polars and Delta Lake
☆10Updated 2 months ago
Alternatives and similar repositories for delta-lake-polars:
Users that are interested in delta-lake-polars are comparing it to the libraries listed below
- ☆30Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆50Updated 5 months ago
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆32Updated 3 months ago
- Example projects built on MotherDuck☆26Updated 2 months ago
- ☆16Updated last year
- API for distributing Data Lake Data☆11Updated last month
- duckdb-etl-framework☆10Updated 4 months ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 10 months ago
- Yet Another (Spark) ETL Framework☆21Updated last year
- Personal project for setting up an open source data warehouse.☆29Updated 3 months ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆32Updated 5 months ago
- rust-for-data☆45Updated last year
- Cost Efficient Data Pipelines with DuckDB☆52Updated 9 months ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- A no code tool to help build pivot tables from any database with a few clicks.☆11Updated last month
- API Framework heavily relying on the power of DuckDB and DuckDB extensions. Ready to build performant and cost-efficient APIs on top of B…☆28Updated last month
- SQL query executor on remote DuckDB instance using Apache Arrow Flight RPC through Streamlit Web interface.☆13Updated 6 months ago
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago
- A duckDB extension implementing a full service AI/ML enginer☆26Updated 6 months ago
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆16Updated 2 weeks ago
- ☆17Updated 8 months ago
- Proof-of-concept extension combining the delta extension with Unity Catalog☆84Updated last week
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆24Updated 6 months ago
- SQLMesh example projects☆26Updated 5 months ago
- Contribute to dlt verified sources 🔥☆83Updated last week
- ☆16Updated 5 months ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆26Updated last year
- A configuration-driven framework for building Dagster pipelines that enables teams to create and manage data workflows using YAML/JSON in…☆31Updated 5 months ago
- Read Apache Arrow batches from ODBC data sources in Python☆65Updated this week