elasticlabs / airflow-jupyter-docker-composeLinks
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 3 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
Sorting:
- manipulate pandas dataframes from the comfort of your browser☆174Updated 4 years ago
- ☆112Updated 8 months ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- dagster scikit-learn pipeline example.☆45Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆86Updated 3 years ago
- Sample projects using Ploomber.☆86Updated last year
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆58Updated 3 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆23Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- ☆74Updated last year
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆99Updated 10 months ago
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆93Updated last year
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆84Updated this week
- 🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & …☆214Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆109Updated 2 years ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks☆21Updated 3 years ago
- The Prefect API and backend☆246Updated last year
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated last week
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆62Updated 2 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆166Updated 2 weeks ago
- An extension to add Prefect flow visualizations into you Sphinx documentation.☆13Updated 3 years ago
- Official dbt adapter for Vertica☆26Updated 3 months ago
- The TimescaleDB adapter plugin for dbt☆42Updated last month
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- A FastAPI CLI & Streamlit App wrapper for Excel files... create APIs from Excel data files within seconds☆72Updated last year
- Prefect API Authentication/Authorization Proxy for on-premises deployments☆41Updated 5 months ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago