airflowdocker / airflow-dockerLinks
An opinionated implementation of exclusively using airflow DockerOperators for all Operators
☆18Updated 3 years ago
Alternatives and similar repositories for airflow-docker
Users that are interested in airflow-docker are comparing it to the libraries listed below
Sorting:
- Docker images for dask☆244Updated last week
- Snowflake SQLAlchemy☆261Updated this week
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆45Updated this week
- Fast iterative local development and testing of Apache Airflow workflows☆204Updated last month
- Astronomer Core Docker Images☆105Updated last year
- Code examples showing flow deployment to various types of infrastructure☆110Updated 3 years ago
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆82Updated this week
- Black for Databricks notebooks☆48Updated 7 months ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- pytest plugin to run the tests with support of pyspark☆88Updated 8 months ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago
- The Prefect API and backend☆250Updated 2 years ago
- Great Expectations Airflow operator☆170Updated last week
- Visualize dependencies between Airflow DAGs☆49Updated 4 years ago
- Python Rest Client to interact against Schema Registry confluent server☆179Updated 2 months ago
- Pylint plugin for static code analysis on Airflow code☆97Updated 5 years ago
- Generate avro schemas from python dataclasses, Pydantic models and Faust Records. Code generation from avro schemas. Serialize/Deserializ…☆248Updated last month
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 3 years ago
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆28Updated 3 years ago
- SQLAlchemy dialect for BigQuery☆489Updated this week
- SQL upsert using pandas DataFrames for PostgreSQL, SQlite and MySQL with extra features☆234Updated 2 years ago
- Native Kubernetes integration for Dask☆324Updated 3 weeks ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 4 years ago
- ☆201Updated 2 years ago
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- SQLAlchemy dialect for Turbodbc☆24Updated 10 months ago
- PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.☆491Updated last week
- Repository to maintain infrastructure to automate Data Workflows☆35Updated 4 years ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆162Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated 3 months ago