elasticlabs / airflow-jupyter-docker-compose
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for airflow-jupyter-docker-compose
- Full stack data engineering tools and infrastructure set-up☆41Updated 3 years ago
- dagster scikit-learn pipeline example.☆43Updated last year
- Sample projects using Ploomber.☆83Updated 9 months ago
- ☆73Updated 2 months ago
- MLflow and Prefect with docker-compose☆16Updated 2 years ago
- ☆109Updated last year
- Notebooks that support blog posts and tech talks on Dask / Coiled.☆45Updated 9 months ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆31Updated 3 years ago
- A Streamlit app to upload files and query with DuckDB☆13Updated 9 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated last year
- Feast AWS guide using Redshift / Spectrum / DynamoDB to build a credit scoring model☆61Updated 3 years ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆24Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆111Updated this week
- Run streamlit web application, test and deploy to a cloud service (GCP, AWS, Heroku)☆14Updated 2 years ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆79Updated this week
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆27Updated 9 months ago
- Dash components & demos to create Altair, Matplotlib, Highcharts , and Bokeh graphs within Dash apps.☆7Updated last month
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- Streamlit deployment on AWS Fargate☆11Updated 4 years ago
- A curated list of dagster code snippets for data engineers☆50Updated 8 months ago
- A tutorial on how to use kedro-mlflow plugin (https://github.com/Galileo-Galilei/kedro-mlflow) to synchronize training and inference and …☆37Updated 2 years ago
- A proof of concept for how to set up a codebase for an analytics org.☆14Updated 3 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆25Updated 8 months ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆18Updated 3 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆44Updated 2 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆39Updated 2 weeks ago
- ☆16Updated 4 months ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆55Updated last year