elasticlabs / airflow-jupyter-docker-compose
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for airflow-jupyter-docker-compose
- Full stack data engineering tools and infrastructure set-up☆44Updated 3 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- ☆109Updated last year
- dagster scikit-learn pipeline example.☆43Updated last year
- Sample projects using Ploomber.☆84Updated 10 months ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆86Updated 3 weeks ago
- This MVP data web app uses the Streamlit framework and Facebook's Prophet forecasting package to generate a dynamic forecast from your ow…☆65Updated 10 months ago
- ☆73Updated 3 months ago
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆10Updated 11 months ago
- a collection of resources and blogs about Apache Superset☆79Updated 2 years ago
- MLflow and Prefect with docker-compose☆16Updated 2 years ago
- Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase☆123Updated 2 years ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated last year
- A proof of concept for how to set up a codebase for an analytics org.☆14Updated 3 years ago
- A collection of python utility functions☆12Updated 4 months ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆79Updated this week
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆55Updated last year
- A tutorial for the Great Expectations library.☆68Updated 3 years ago
- ☆13Updated 2 years ago
- Notebooks that support blog posts and tech talks on Dask / Coiled.☆45Updated 9 months ago
- Read Delta tables without any Spark☆47Updated 8 months ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆18Updated 3 years ago
- An extension to add Prefect flow visualizations into you Sphinx documentation.☆14Updated 2 years ago
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆31Updated 3 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆58Updated last year
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆57Updated 2 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated last year
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆111Updated 7 months ago