elasticlabs / airflow-jupyter-docker-compose
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
☆35Updated 2 years ago
Alternatives and similar repositories for airflow-jupyter-docker-compose:
Users that are interested in airflow-jupyter-docker-compose are comparing it to the libraries listed below
- dagster scikit-learn pipeline example.☆44Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆38Updated 2 months ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆48Updated 3 years ago
- Sample projects using Ploomber.☆85Updated last year
- A curated list of dagster code snippets for data engineers☆53Updated 11 months ago
- ☆110Updated last month
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- Demo of Streamlit application with Databricks SQL Endpoint☆34Updated 2 years ago
- Code from articles that I have written☆43Updated 9 months ago
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- Official dbt adapter for Vertica☆25Updated last month
- Cost Efficient Data Pipelines with DuckDB☆48Updated 5 months ago
- PipeRider dbt workshop for DataTalksClub DE Zoomcamp☆17Updated last year
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆11Updated last year
- This MVP data web app uses the Streamlit framework and Facebook's Prophet forecasting package to generate a dynamic forecast from your ow…☆66Updated last year
- Data models for Hubspot built using dbt.☆34Updated this week
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆52Updated 2 years ago
- ☆31Updated last month
- A simple and easy to use Data Quality (DQ) tool built with Python.☆49Updated last year
- git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit☆53Updated last year
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆31Updated 3 years ago
- Get started with Apache Airflow. Check the README for instructions on how to run your first DAGs today. 🚀☆51Updated last month
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆37Updated 5 years ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆55Updated 2 years ago
- ☆18Updated 5 months ago
- ☆11Updated 2 years ago
- Streamlit application to explore Snowflake Tables☆39Updated last year
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆71Updated 3 years ago