☆41Jan 24, 2023Updated 3 years ago
Alternatives and similar repositories for docker-spark-airflow
Users that are interested in docker-spark-airflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- Docker with Airflow and Spark standalone cluster☆263Aug 5, 2023Updated 3 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆34May 30, 2026Updated 3 months ago
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆29Sep 9, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Dataproc Scala Examples is an effort to assist in the creation of Spark jobs written in Scala to run on Dataproc.☆12Mar 26, 2026Updated 5 months ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆49Oct 9, 2022Updated 3 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆16Sep 3, 2021Updated 4 years ago
- ☆19Feb 25, 2022Updated 4 years ago
- ☆10Jul 27, 2021Updated 5 years ago
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- Guide on how to setup Apache Airflow containers using Docker and IBM Bluemix☆11Feb 19, 2018Updated 8 years ago
- Dockerizing and Consuming an Apache Livy environment☆13Jun 29, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- All content about Master in Artificial Intelligence from UPC UB URV☆12Feb 15, 2023Updated 3 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- DNE4py is a python library that aims to run and visualize many different evolutionary algorithms with high performance using mpi4py. It a…☆10Oct 13, 2020Updated 5 years ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Mar 29, 2021Updated 5 years ago
- Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video wal…☆110Jul 8, 2026Updated last month
- open source data lake☆32Jan 17, 2025Updated last year
- ☆10Nov 23, 2020Updated 5 years ago
- Data Analysis and Image Processing Python Course☆12Nov 4, 2014Updated 11 years ago
- ☆10Jul 24, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club☆59Mar 10, 2025Updated last year
- Music App based on Spotify API and Streamlit framework☆16Oct 17, 2025Updated 10 months ago
- ReactTS/FastAPI template☆24May 23, 2026Updated 3 months ago
- Example of how to leverage Apache Spark distributed capabilities to call REST-API using a UDF☆51Oct 11, 2022Updated 3 years ago
- ☆13Jul 6, 2018Updated 8 years ago
- ☆25Mar 15, 2024Updated 2 years ago
- ☆37Jan 29, 2021Updated 5 years ago
- A script/docker that automatically translates PDFs using the DeepL API☆14Jul 19, 2026Updated last month
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Python package extending pandas with helper functions for simpler exploratory data analysis and data wrangling.☆11Feb 6, 2025Updated last year
- Source Code for the video series on developing a pushups logger web application with CRUD and user authentication features using Flask.☆29Sep 23, 2022Updated 3 years ago
- ☆15Mar 10, 2026Updated 5 months ago
- An MOOC offered by the University of Helsinki. Course information can be found below☆10Jun 10, 2021Updated 5 years ago
- Deploy a Machine Learning Model as an API on AWS☆15Jun 21, 2022Updated 4 years ago
- An MLflow Provider Package for Apache Airflow☆26Oct 22, 2025Updated 10 months ago
- ☆14Jun 29, 2017Updated 9 years ago