allegro / bigflow
A Python framework for data processing on GCP.
☆118Updated last week
Alternatives and similar repositories for bigflow:
Users that are interested in bigflow are comparing it to the libraries listed below
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- Astronomer Core Docker Images☆106Updated 10 months ago
- ☆198Updated last year
- Fast iterative local development and testing of Apache Airflow workflows☆197Updated 3 months ago
- Apache (Py)Spark type annotations (stub files).☆116Updated 2 years ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆65Updated 4 years ago
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated last year
- Apache Airflow integration for dbt☆400Updated 10 months ago
- Great Expectations Airflow operator☆161Updated this week
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆146Updated this week
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆390Updated this week
- Kedro Plugin to support running pipelines on Kubernetes using Airflow.☆28Updated last week
- ☆49Updated 8 months ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Making DAG construction easier☆258Updated 2 weeks ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Airflow Unit Tests and Integration Tests☆256Updated 2 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated 11 months ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- Data ingestion library for Amundsen to build graph and search index☆205Updated last year
- BigQuery Column Lineage parser☆60Updated 6 months ago
- A simple Spark-powered ETL framework that just works 🍺☆181Updated 3 weeks ago
- Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables☆73Updated last year
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- a dbt package to make auditing dbt runs easy.☆98Updated 3 months ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆219Updated last week
- Make simple storing test results and visualisation of these in a BI dashboard☆42Updated this week