elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- dagster scikit-learn pipeline example.☆43Updated 2 years ago
- ☆21Updated 2 months ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆42Updated 6 months ago
- Prefect API Authentication/Authorization Proxy for on-premises deployments☆39Updated last month
- a collection of resources and blogs about Apache Superset☆82Updated 3 years ago
- ☆28Updated 2 years ago
- Demo of Streamlit application with Databricks SQL Endpoint☆35Updated 2 years ago
- ☆18Updated 9 months ago
- An extension to add Prefect flow visualizations into you Sphinx documentation.☆13Updated 3 years ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset☆53Updated 6 months ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆95Updated 7 months ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- ☆74Updated 9 months ago
- Simple Dash app demonstrating connection to Databricks via the Python SQL connector☆35Updated 4 months ago
- Cost Efficient Data Pipelines with DuckDB☆53Updated 3 weeks ago
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆92Updated 9 months ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.☆57Updated 3 years ago
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆57Updated 3 years ago
- ☆37Updated 2 months ago
- ☆110Updated 5 months ago
- A monorepo of many Rill example projects☆37Updated last week
- Utility functions for dbt projects running on Spark☆34Updated 3 months ago
- New generation opensource data stack☆68Updated 3 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 3 years ago
- Stupidly simple Python Package to build front end dashboards within Python☆20Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago