dimajix / docker-jupyter-spark
Docker image for Jupyter notebooks with PySpark
☆27Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for docker-jupyter-spark
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆173Updated last year
- Repository used for Spark Trainings☆53Updated last year
- spark on kubernetes☆105Updated last year
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆119Updated 3 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆195Updated 4 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆86Updated 5 years ago
- PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2☆83Updated 4 years ago
- ☆14Updated 5 years ago
- ETL pipeline using pyspark (Spark - Python)☆108Updated 4 years ago
- Materials of the Official Helm Chart Webinar☆27Updated 3 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 3 years ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆55Updated 11 months ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆209Updated last year
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 3 years ago
- ☆196Updated last year
- Examples To Help You Learn Apache Spark☆77Updated 6 years ago
- Repository of sample Databricks notebooks☆247Updated 7 months ago
- Spark style guide☆256Updated last month
- Various data stream/batch process demo with Apache Scala Spark 🚀☆11Updated 4 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆26Updated 3 years ago
- An example PySpark project with pytest☆17Updated 7 years ago
- Apache Spark Course Material☆85Updated last year
- Spark and Delta Lake Workshop☆22Updated 2 years ago