fugue-project / tutorials
Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask without any rewrites.
☆113Updated 11 months ago
Alternatives and similar repositories for tutorials:
Users that are interested in tutorials are comparing it to the libraries listed below
- IbisML is a library for building scalable ML pipelines using Ibis.☆104Updated 2 months ago
- An abstraction layer for parameter tuning☆35Updated 6 months ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆183Updated last week
- Plugins, extensions, case studies, articles, and video tutorials for Kedro☆71Updated 3 months ago
- Fake Pandas / PySpark DataFrame creator☆46Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆53Updated 6 months ago
- Pandas helper functions☆30Updated 2 years ago
- ✨ A Pydantic to PySpark schema library☆72Updated this week
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆206Updated 2 weeks ago
- Dask integration for Snowflake☆30Updated 4 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆49Updated last year
- Delta Lake helper methods. No Spark dependency.☆23Updated 6 months ago
- Write python locally, execute SQL in your data warehouse☆270Updated 2 years ago
- Write your dbt models using Ibis☆64Updated this week
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆80Updated 2 years ago
- Templates for your Kedro projects.☆72Updated this week
- Polars plugin offering eXtra stuff for DateTimes☆198Updated 3 months ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 7 months ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆123Updated 3 years ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- PySpark schema generator☆42Updated 2 years ago
- Demo of Streamlit application with Databricks SQL Endpoint☆36Updated 2 years ago
- A data modelling layer built on top of polars and pydantic☆195Updated last year
- ☆69Updated 3 weeks ago
- Code examples showing flow deployment to various types of infrastructure☆104Updated 2 years ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated 10 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆42Updated last month
- A Python Library to support running data quality rules while the spark job is running⚡☆176Updated last week
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Read Apache Arrow batches from ODBC data sources in Python☆64Updated last week