dimajix / docker-jupyter-spark
Docker image for Jupyter notebooks with PySpark
☆27Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for docker-jupyter-spark
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆172Updated 11 months ago
- Repository used for Spark Trainings☆53Updated last year
- Airflow training for the crunch conf☆105Updated 6 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- spark on kubernetes☆105Updated last year
- ETL pipeline using pyspark (Spark - Python)☆108Updated 4 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 3 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆119Updated 3 years ago
- Databricks - Apache Spark™ - 2X Certified Developer☆264Updated 4 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆86Updated 5 years ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆55Updated 11 months ago
- How to build an awesome data engineering team☆99Updated 5 years ago
- Materials of the Official Helm Chart Webinar☆27Updated 3 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆195Updated 4 years ago
- Docker with Airflow and Spark standalone cluster☆242Updated last year
- Spark style guide☆257Updated last month
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 2 years ago
- ☆196Updated last year
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 3 years ago
- Apache Spark Course Material☆85Updated last year
- Fundamentals of Spark with Python (using PySpark), code examples☆331Updated 2 years ago
- Filling in the Spark function gaps across APIs☆50Updated 3 years ago