elasticlabs / airflow-jupyter-docker-compose
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose:
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆27Updated last year
- dagster scikit-learn pipeline example.☆44Updated last year
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆82Updated 9 months ago
- ☆110Updated last month
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆11Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆131Updated last month
- Notebooks that support blog posts and tech talks on Dask / Coiled.☆47Updated last year
- Bare bones use-case for deploying a containerized web app (built in streamlit) on AWS.☆92Updated 6 months ago
- a collection of resources and blogs about Apache Superset☆81Updated 3 years ago
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆57Updated 3 years ago
- manipulate pandas dataframes from the comfort of your browser☆171Updated 3 years ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆90Updated 3 months ago
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆31Updated 4 years ago
- Docker template for basic data science packages to interface with Neo4j☆14Updated 3 years ago
- PipeRider dbt workshop for DataTalksClub DE Zoomcamp☆17Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆38Updated 3 months ago
- Prefect API Authentication/Authorization Proxy for on-premises deployments☆36Updated 2 months ago
- Full stack data engineering tools and infrastructure set-up☆49Updated 4 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆52Updated 2 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- A FastAPI CLI & Streamlit App wrapper for Excel files... create APIs from Excel data files within seconds☆70Updated last year
- Sample projects using Ploomber.☆86Updated last year
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆160Updated 9 months ago
- A tutorial for the Great Expectations library.☆69Updated 4 years ago
- Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.☆44Updated 5 years ago
- Airflow operator that can send messages to MS Teams☆83Updated 5 months ago
- ☆19Updated last year
- An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks☆21Updated 2 years ago
- Lux Binder Examples☆32Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year