☆41Jan 24, 2023Updated 3 years ago
Alternatives and similar repositories for docker-spark-airflow
Users that are interested in docker-spark-airflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 3 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆35Sep 4, 2026Updated last month
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆49Oct 9, 2022Updated 4 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆16Sep 3, 2021Updated 5 years ago
- ☆12Mar 17, 2022Updated 4 years ago
- Spark Standalone & Livy☆11Jul 13, 2021Updated 5 years ago
- Dockerizing and Consuming an Apache Livy environment☆13Jun 29, 2022Updated 4 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- Repository for IAE architectural documents.☆19May 15, 2018Updated 8 years ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Mar 29, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.☆13Sep 5, 2024Updated 2 years ago
- open source data lake☆32Jan 17, 2025Updated last year
- ☆10Nov 23, 2020Updated 5 years ago
- Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video wal…☆111Jul 8, 2026Updated 3 months ago
- Typings for Confluent Kafka Python Client☆27Apr 11, 2026Updated 6 months ago
- ☆10Jul 24, 2024Updated 2 years ago
- Music App based on Spotify API and Streamlit framework☆16Oct 17, 2025Updated 11 months ago
- A repository to store example files and projects for my YouTube series **Docker Development Tips & Tricks**☆12Dec 1, 2021Updated 4 years ago
- ☆11Apr 9, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated 2 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Oct 4, 2026Updated last week
- End-to-end real-time analytics pipeline with Kafka, Spark micro-batch/Spark Streaming/Flink, ClickHouse, and live dashboards.☆19Mar 2, 2026Updated 7 months ago
- learning logstash and elastic search plugins☆21Jul 15, 2022Updated 4 years ago
- ☆15Mar 10, 2026Updated 7 months ago
- An MLflow Provider Package for Apache Airflow☆26Oct 22, 2025Updated 11 months ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆47Mar 14, 2024Updated 2 years ago
- [부스트캠프 AI Tech 3기 최종 프로젝트] 산타 백준 - 개인화 코딩 문제 추천 웹서비스☆11Jul 4, 2022Updated 4 years ago
- Dask on ECS Fargate☆14Sep 23, 2019Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Selenium Grid in ECS using Fargate Spot Containers☆14Feb 1, 2023Updated 3 years ago
- Compare DuckDB, Polars and Pandas for generating an artificial dataset of persons and companies☆36Aug 31, 2023Updated 3 years ago
- ☆13Nov 12, 2022Updated 3 years ago
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- Roadmap for all those who want to get a kick start as Data Scientist.☆10Feb 2, 2022Updated 4 years ago
- Flights Search Application GRANDstack Experimental Implementation☆23Mar 4, 2023Updated 3 years ago
- 💻👨💻⌨️️ Streaming service with ETL on steroids☆19Feb 23, 2025Updated last year