dennisobrien / airflow-docker-compose-exampleLinks
Example implementation running Airflow as separate services with docker-compose.
☆20Updated 7 years ago
Alternatives and similar repositories for airflow-docker-compose-example
Users that are interested in airflow-docker-compose-example are comparing it to the libraries listed below
Sorting:
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated 2 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 7 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 6 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated 3 weeks ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 2 months ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆160Updated last week
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- tap-postgres☆68Updated last year
- The sane way of building a data layer in Airflow☆24Updated 6 years ago
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 6 months ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 2 months ago
- Convert a CSV fle to ORCFile☆26Updated 6 years ago
- SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon☆61Updated 5 years ago
- 📆 Run, schedule, and manage your dbt jobs using Kubernetes.☆25Updated 7 years ago
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated 2 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Updated last year
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Updated 2 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆52Updated 5 months ago
- A Singer.io Target for the Stitch Import API☆26Updated 2 months ago
- ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.☆42Updated 11 months ago
- Faker for Snowflake!☆33Updated 2 years ago
- ☆98Updated 2 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆37Updated 5 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago