Building a Modern Data Lake with Minio, Spark, Airflow via Docker.
☆23May 11, 2024Updated 2 years ago
Alternatives and similar repositories for docker-airflow-spark
Users that are interested in docker-airflow-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open episode of the data engineering practice course☆31Jul 2, 2024Updated 2 years ago
- The simple ETL with docker container☆71May 30, 2025Updated last year
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- Update, Upsert, and Merge from Python dataframes to SQL Server and Azure SQL database.☆12May 30, 2024Updated 2 years ago
- ☆19Feb 25, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Spark Standalone & Livy☆11Jul 13, 2021Updated 5 years ago
- This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)☆11Apr 29, 2022Updated 4 years ago
- Dockerizing and Consuming an Apache Livy environment☆13Jun 29, 2022Updated 4 years ago
- ☆16Jan 19, 2022Updated 4 years ago
- This repository contains a set of hands-on challenges designed to introduce you to Dapr's most popular APIs and give you a starting point…☆24Dec 11, 2024Updated last year
- ☆41Jan 24, 2023Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 3 years ago
- Simplifying Data Engineering and Analytics with Delta, published by Packt☆22Sep 20, 2023Updated 3 years ago
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆50Oct 14, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Dec 19, 2025Updated 10 months ago
- Writing PySpark logs in Apache Spark and Databricks☆16Jun 13, 2022Updated 4 years ago
- Build a better understanding of your data in PostgreSQL.☆26Jul 11, 2021Updated 5 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 4 years ago
- A compilation of components to optimize the development of your ecommerce☆13Oct 28, 2026Updated last week
- ☆37Jan 29, 2021Updated 5 years ago
- Collection of dockerized ETL jobs managed by data engineering.☆24Updated this week
- 👾 Repositório para armazenar todos os componentes referentes a aplicação Backend do projeto☆10Apr 27, 2024Updated 2 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆35Sep 4, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- gemini cli hooks - adding voice on each hook☆13May 26, 2026Updated 5 months ago
- Data Engineering reference architecture for Kubernetes-based data platforms using GitOps workflow patterns. Includes infrastructure confi…☆14May 14, 2025Updated last year
- A Postgres data warehouse for processing synthetic data using IAC principles☆19Feb 27, 2023Updated 3 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆83Aug 21, 2023Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆266Oct 26, 2026Updated last week
- Interactive Mojo integration for Python notebooks - three patterns for running high-performance Mojo code from marimo☆13Sep 6, 2026Updated 2 months ago
- Code to demonstrate data engineering metadata & logging best practices☆21Mar 12, 2024Updated 2 years ago
- Template Dagster repo using poetry and a single Docker container; works well with CICD☆67Apr 1, 2022Updated 4 years ago
- ☆11Jul 30, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The "World Data Report" is a Power BI project that offers a detailed overview of global data, covering weather, geographical, demographic…☆15Nov 30, 2025Updated 11 months ago
- A fast development template for Admin-dashboard based on Ext JS Classic toolkit☆10Jun 29, 2018Updated 8 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆38Sep 1, 2023Updated 3 years ago
- A curated list of data engineering tools for software developers☆10Jun 23, 2017Updated 9 years ago
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- A business intelligence dashboard for the fictional AdventureWorks bike manufacturer, built in Microsoft Power BI.☆14Aug 3, 2023Updated 3 years ago
- Spark Playground repo based on Docker☆10Nov 8, 2025Updated 11 months ago