☆41Jan 24, 2023Updated 3 years ago
Alternatives and similar repositories for docker-spark-airflow
Users that are interested in docker-spark-airflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆35Sep 4, 2026Updated 2 weeks ago
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆16Sep 3, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆19Feb 25, 2022Updated 4 years ago
- ☆15Jun 22, 2026Updated 3 months ago
- Demo of using Airflow☆11Jun 24, 2022Updated 4 years ago
- Guide on how to setup Apache Airflow containers using Docker and IBM Bluemix☆11Feb 19, 2018Updated 8 years ago
- Geospatial Next.js app with DuckDB-Wasm☆15May 24, 2023Updated 3 years ago
- This repository contains a set of hands-on challenges designed to introduce you to Dapr's most popular APIs and give you a starting point…☆22Dec 11, 2024Updated last year
- ☆23Mar 21, 2023Updated 3 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- DNE4py is a python library that aims to run and visualize many different evolutionary algorithms with high performance using mpi4py. It a…☆10Oct 13, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Mar 29, 2021Updated 5 years ago
- Singapore Condo Rental Prices - From Data Acquisition to Prediction☆14Feb 13, 2021Updated 5 years ago
- This is a boilerplate which has dependencies for pyspark(3.3.0) mongo(>4.x) connectivity☆10May 3, 2024Updated 2 years ago
- NLP book recommender system using a series of book descriptions. TensorFlow, Gensim, Janome, Optuna.☆11Sep 11, 2020Updated 6 years ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- open source data lake☆32Jan 17, 2025Updated last year
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated 2 years ago
- Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video wal…☆111Jul 8, 2026Updated 2 months ago
- Data Analysis and Image Processing Python Course☆12Nov 4, 2014Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Jul 24, 2024Updated 2 years ago
- Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club☆60Mar 10, 2025Updated last year
- Data Engineering portfolio projects, resources used to study data tools...☆30Mar 25, 2024Updated 2 years ago
- A repository to store example files and projects for my YouTube series **Docker Development Tips & Tricks**☆12Dec 1, 2021Updated 4 years ago
- ☆11Apr 9, 2017Updated 9 years ago
- A script/docker that automatically translates PDFs using the DeepL API☆14Jul 19, 2026Updated 2 months ago
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Updated this week
- A Python package extending pandas with helper functions for simpler exploratory data analysis and data wrangling.☆11Feb 6, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fused MCP Agents: Setting up MCP Servers for Data Scientists☆26Aug 7, 2025Updated last year
- End-to-end real-time analytics pipeline with Kafka, Spark micro-batch/Spark Streaming/Flink, ClickHouse, and live dashboards.☆19Mar 2, 2026Updated 6 months ago
- Dataset: BuzzFeed News “Trending” Strip, 2018–2023☆18May 24, 2023Updated 3 years ago
- An MLflow Provider Package for Apache Airflow☆26Oct 22, 2025Updated 11 months ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆48Mar 14, 2024Updated 2 years ago
- [부스트캠프 AI Tech 3기 최종 프로젝트] 산타 백준 - 개인화 코딩 문제 추천 웹서비스☆11Jul 4, 2022Updated 4 years ago
- Dask on ECS Fargate☆14Sep 23, 2019Updated 6 years ago