kadnan / docker-spark-clusterLinks
A simple spark standalone cluster for your testing environment purposses
☆23Updated 5 years ago
Alternatives and similar repositories for docker-spark-cluster
Users that are interested in docker-spark-cluster are comparing it to the libraries listed below
Sorting:
- Repository used for Spark Trainings☆54Updated 2 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆89Updated 4 years ago
- ☆202Updated 2 years ago
- Weekly Data Engineering Newsletter☆96Updated last year
- Spark style guide☆271Updated last year
- The official repository for the Rock the JVM Spark Optimization 2 course☆42Updated 2 years ago
- Airflow training for the crunch conf☆104Updated 7 years ago
- Various data stream/batch process demo with Apache Scala Spark 🚀☆11Updated 5 years ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆58Updated 2 years ago
- Repository of sample Databricks notebooks☆274Updated last year
- Spark and Delta Lake Workshop☆22Updated 3 years ago
- Databricks - Apache Spark™ - 2X Certified Developer☆265Updated 5 years ago
- A boilerplate for writing PySpark Jobs☆395Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- Course materials for my data pipeline video course with O'Reilly☆201Updated 8 years ago
- Airflow basics tutorial☆396Updated 4 years ago
- Flowchart for debugging Spark applications☆107Updated last year
- An example mini data warehouse for python project stats, template for new projects☆178Updated 5 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 3 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- ☆248Updated 6 years ago
- How to build an awesome data engineering team☆101Updated 6 years ago
- A tool to validate data, built around Apache Spark.☆100Updated this week
- Code to build a simple analytics data pipeline with Python☆102Updated 8 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 5 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 6 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆197Updated 5 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- ☆313Updated 7 years ago
- Docker image for Jupyter notebooks with PySpark☆27Updated 7 years ago