elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆163Updated last year
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆22Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆83Updated 3 years ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- manipulate pandas dataframes from the comfort of your browser☆173Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- 🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & …☆213Updated 2 years ago
- ☆111Updated 6 months ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆96Updated 8 months ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- A curated list of dagster code snippets for data engineers☆56Updated last year
- An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks☆21Updated 2 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆86Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- Sample projects using Ploomber.☆86Updated last year
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆92Updated 11 months ago
- A minimum reproducible repository for embedding panel in FastAPI☆18Updated 3 years ago
- dagster scikit-learn pipeline example.☆44Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆107Updated 2 years ago
- ☆48Updated 3 years ago
- 🐳 An all-in-one Docker image for machine learning. Contains all the popular python machine learning librairies (scikit-learn, xgboost, L…☆79Updated 5 months ago
- just a plotly gantt chart with a bunch of configs that weren't easy to find☆18Updated 4 years ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- This is where to start the data transformation with dbt and PostgreSQL☆8Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- MLflow and Prefect with docker-compose☆16Updated 2 years ago
- Astronomer Core Docker Images☆107Updated last year
- Quickly ingest messy CSV and XLS files. Export to clean pandas, SQL, parquet☆196Updated 2 years ago
- Simple Dash app demonstrating connection to Databricks via the Python SQL connector☆35Updated 5 months ago
- Data models for Hubspot built using dbt.☆35Updated this week