elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 3 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- ☆112Updated 9 months ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- manipulate pandas dataframes from the comfort of your browser☆174Updated 4 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆125Updated 4 years ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- 🐍💨 Airflow tutorial for PyCon 2019☆86Updated 2 years ago
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆58Updated 3 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆23Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- dagster scikit-learn pipeline example.☆45Updated 2 years ago
- 🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & …☆214Updated 2 years ago
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆93Updated last year
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- A curated list of dagster code snippets for data engineers☆56Updated last year
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆100Updated 11 months ago
- Delta-Lake, ETL, Spark, Airflow☆48Updated 3 years ago
- Sample projects using Ploomber.☆86Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆121Updated 2 years ago
- A FastAPI CLI & Streamlit App wrapper for Excel files... create APIs from Excel data files within seconds☆72Updated last year
- This is a compilation of Data Governance resources, examples, models and communities☆16Updated 6 years ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- ☆74Updated last year
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆84Updated this week
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Updated last year
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆36Updated 6 years ago
- a collection of resources and blogs about Apache Superset☆87Updated 3 years ago
- Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables☆74Updated last year
- A tutorial for the Great Expectations library.☆73Updated 4 years ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated last month