elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 3 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- Delta-Lake, ETL, Spark, Airflow☆48Updated 3 years ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- dagster scikit-learn pipeline example.☆46Updated 2 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆23Updated 3 years ago
- manipulate pandas dataframes from the comfort of your browser☆174Updated 4 years ago
- a collection of resources and blogs about Apache Superset☆88Updated 3 years ago
- A curated list of dagster code snippets for data engineers☆56Updated last year
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆93Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆100Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆124Updated 2 years ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆49Updated last year
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated 2 years ago
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆116Updated 2 years ago
- A tutorial for the Great Expectations library.☆73Updated 4 years ago
- ☆112Updated 10 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last week
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆125Updated 4 years ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- ☆48Updated 3 years ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆84Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆172Updated last month
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- ☆19Updated 3 months ago
- ☆74Updated last year