☆41Jan 24, 2023Updated 3 years ago
Alternatives and similar repositories for docker-spark-airflow
Users that are interested in docker-spark-airflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 3 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆35Sep 4, 2026Updated last month
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF☆51Oct 11, 2022Updated 4 years ago
- Delta-Lake, ETL, Spark, Airflow☆49Oct 9, 2022Updated 4 years ago
- ☆19Feb 25, 2022Updated 4 years ago
- Spark Standalone & Livy☆11Jul 13, 2021Updated 5 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆16Sep 3, 2021Updated 5 years ago
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- ☆12Mar 17, 2022Updated 4 years ago
- Guide on how to setup Apache Airflow containers using Docker and IBM Bluemix☆11Feb 19, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Geospatial Next.js app with DuckDB-Wasm☆15May 24, 2023Updated 3 years ago
- Dockerizing and Consuming an Apache Livy environment☆13Jun 29, 2022Updated 4 years ago
- SonarQube sobre Docker☆13Nov 7, 2021Updated 4 years ago
- This repository contains a set of hands-on challenges designed to introduce you to Dapr's most popular APIs and give you a starting point…☆24Dec 11, 2024Updated last year
- Template for Scala Spark with Unit Test☆13Jul 24, 2023Updated 3 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- Data Guy Story commandline☆11Dec 2, 2022Updated 3 years ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Mar 29, 2021Updated 5 years ago
- This is a boilerplate which has dependencies for pyspark(3.3.0) mongo(>4.x) connectivity☆10May 3, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.☆13Sep 5, 2024Updated 2 years ago
- ☆10Nov 23, 2020Updated 5 years ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated 2 years ago
- gemini cli hooks - adding voice on each hook☆12May 26, 2026Updated 5 months ago
- Typings for Confluent Kafka Python Client☆27Apr 11, 2026Updated 6 months ago
- NSObject+GCD: Category on NSObject with methods that wrap some of the GCD functions.☆12Sep 8, 2012Updated 14 years ago
- Data Analysis and Image Processing Python Course☆12Nov 4, 2014Updated 11 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆83Aug 21, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Jan 19, 2022Updated 4 years ago
- Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video wal…☆112Jul 8, 2026Updated 3 months ago
- ☆13Jul 6, 2018Updated 8 years ago
- Music App based on Spotify API and Streamlit framework☆16Oct 17, 2025Updated last year
- An attempt to use natural language processing techniques in order to aid stock price forecasts.☆15Oct 4, 2017Updated 9 years ago
- An AI-powered assistant that translates natural language into SQL queries for Salesforce Marketing Cloud (SFMC). Using GPT-4o, this tool …☆12Mar 3, 2025Updated last year
- Trying to use Pydantic to validate returned Scrapy items☆10May 12, 2021Updated 5 years ago