fugue-project / tutorials
Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask without any rewrites.
☆113Updated 10 months ago
Alternatives and similar repositories for tutorials:
Users that are interested in tutorials are comparing it to the libraries listed below
- Possibly the fastest DataFrame-agnostic quality check library in town.☆180Updated this week
- IbisML is a library for building scalable ML pipelines using Ibis.☆96Updated last month
- Plugins, extensions, case studies, articles, and video tutorials for Kedro☆68Updated last month
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆54Updated 4 months ago
- Fake Pandas / PySpark DataFrame creator☆44Updated 10 months ago
- An abstraction layer for parameter tuning☆36Updated 4 months ago
- Dask integration for Snowflake☆30Updated 2 months ago
- ✨ A Pydantic to PySpark schema library☆64Updated this week
- Delta Lake helper methods. No Spark dependency.☆22Updated 4 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆49Updated last year
- Demo of Streamlit application with Databricks SQL Endpoint☆34Updated 2 years ago
- Pandas helper functions☆30Updated last year
- Write your dbt models using Ibis☆58Updated 2 weeks ago
- Cost Efficient Data Pipelines with DuckDB☆48Updated 5 months ago
- Build your feature store with macros right within your dbt repository☆38Updated 2 years ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆41Updated this week
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆192Updated last month
- A curated list of dagster code snippets for data engineers☆53Updated 11 months ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆81Updated 8 months ago
- ☆65Updated 5 months ago
- rust-for-data☆44Updated last year
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆78Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated 5 months ago
- [DEPRECATED] A dbt adapter for Excel.☆91Updated last year
- Make simple storing test results and visualisation of these in a BI dashboard☆40Updated last month
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- Templates for your Kedro projects.☆71Updated last week
- A Python Library to support running data quality rules while the spark job is running⚡☆168Updated this week