yodasco / pyspark-emr

Related projects ⓘ

Alternatives and complementary repositories for pyspark-emr

• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 7 years ago
• holdenk / spark-intro-ml-pipeline-workshop
  A simple introduction to using spark ml pipelines
  ☆26Updated 6 years ago
• felixcheung / spark-notebook-examples
  Some notebook examples related to Apache Spark, IPython / Jupyter, Zeppelin
  ☆52Updated 8 years ago
• datitran / emr-bootstrap-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR
  ☆53Updated 7 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆75Updated 5 years ago
• rdblue / jupyter-zeppelin
  Conversion utility from Zeppelin notes to Jupyter notebooks.
  ☆44Updated 4 years ago
• PacktPublishing / Mastering-Spark-for-Data-Science
  Mastering Spark for Data Science, published by Packt
  ☆46Updated last year
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆51Updated last year
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• jerzygangi / forklift
  🚚 ETL for Spark and Airflow
  ☆24Updated 6 years ago
• pranab / ruscello
  Real time and offline time series analysis with Spark, Spark Streaming and Storm
  ☆21Updated 4 years ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 3 weeks ago
• ceteri / spark-exercises
  Coding exercises for Apache Spark
  ☆104Updated 9 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 4 years ago
• simonellistonball / masterclass-hdf
  HDF masterclass materials
  ☆28Updated 8 years ago
• shlin168 / airflow-event-plugins
  event-triggered plugins for airflow
  ☆21Updated 4 years ago
• snowplow-archive / spark-example-project
  A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
  ☆118Updated 8 years ago
• ShopRunner / stork
  Make your libraries magically appear in Databricks.
  ☆47Updated last year
• dimajix / terraform-emr-training
  Terraform script for launching multiple EMR clusters for training purposes.
  ☆16Updated last year
• tmalaska / Spark.TableStatsExample
  Simple Spark example of generating table stats for use of data quality checks
  ☆28Updated 7 years ago
• adobe-research / spark-cluster-deployment
  Automates Spark standalone cluster tasks with Puppet and Fabric.
  ☆43Updated 10 years ago
• cartershanklin / csv-to-orc
  Convert a CSV fle to ORCFile
  ☆26Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆68Updated 5 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 6 years ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 6 years ago