allegro / bigflow
A Python framework for data processing on GCP.
☆118Updated last month
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Make simple storing test results and visualisation of these in a BI dashboard☆44Updated last month
- Pylint plugin for static code analysis on Airflow code☆94Updated 4 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆200Updated 3 weeks ago
- ☆199Updated last year
- BigQuery Column Lineage parser☆61Updated 8 months ago
- Spark SQL magic command for Jupyter notebooks☆36Updated 4 years ago
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated last year
- Airflow Backfill UI based plugin for existing / new Airflow environment☆65Updated 4 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated last year
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- Visualize dependencies between Airflow DAGs☆49Updated 4 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- Astronomer Core Docker Images☆107Updated 11 months ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆397Updated this week
- Great Expectations Airflow operator☆163Updated this week
- Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables☆74Updated last year
- Airflow Unit Tests and Integration Tests☆258Updated 2 years ago
- Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.☆143Updated 11 months ago
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆54Updated 8 months ago
- Kedro Plugin to support running pipelines on Kubernetes using Airflow.☆28Updated 2 months ago
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆109Updated this week
- Making DAG construction easier☆265Updated this week
- Parse dbt artifacts and search dbt models with Algolia☆52Updated 4 years ago
- Pytest plugin for dbt core☆60Updated 4 months ago
- A curated collection of publicly available resources on dbt best practices and how data-driven organizations around the world utilize dbt☆113Updated 3 years ago
- Dry run capability for dbt projects using BigQuery☆97Updated last month
- Data Tools Subjective List☆83Updated last year
- BigQuery Google Storage Based Data Loader☆57Updated 2 weeks ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆148Updated this week
- a dbt package to make auditing dbt runs easy.☆100Updated 5 months ago