elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆36Updated 3 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆101Updated last year
- dagster scikit-learn pipeline example.☆46Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆89Updated 4 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆23Updated 3 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Snippets and templates representing common Customer Success patterns☆258Updated 11 months ago
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆126Updated 2 years ago
- Sample projects using Ploomber.☆86Updated last year
- ☆74Updated last year
- ☆23Updated 2 months ago
- Delta-Lake, ETL, Spark, Airflow☆48Updated 3 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆176Updated last month
- manipulate pandas dataframes from the comfort of your browser☆174Updated 4 years ago
- A tutorial for the Great Expectations library.☆73Updated 4 years ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆84Updated this week
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- A curated list of dagster code snippets for data engineers☆56Updated last year
- The Prefect API and backend☆248Updated 2 years ago
- Official dbt adapter for Vertica☆27Updated 6 months ago
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆93Updated last year
- ☆113Updated 11 months ago
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆108Updated 2 years ago
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆116Updated 2 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- New generation opensource data stack☆76Updated 3 years ago