Alternatives and similar repositories for pyspark-emr:

Users that are interested in pyspark-emr are comparing it to the libraries listed below

• MrPowers / gill
  An example PySpark project with pytest
  ☆16Updated 7 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 5 months ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• groupon / luigi-warehouse
  A luigi powered analytics / warehouse stack
  ☆88Updated 8 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 5 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆52Updated 2 years ago
• ShopRunner / stork
  Make your libraries magically appear in Databricks.
  ☆47Updated last year
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• datitran / emr-bootstrap-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR
  ☆53Updated 8 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 6 years ago
• adobe-research / spark-cluster-deployment
  Automates Spark standalone cluster tasks with Puppet and Fabric.
  ☆43Updated 10 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 7 months ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• tmalaska / Spark.TableStatsExample
  Simple Spark example of generating table stats for use of data quality checks
  ☆28Updated 7 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆75Updated 6 years ago
• max-webster / get-started-impala
  This is the example code repository for Getting Started with Impala by John Russell (O'Reilly Media)
  ☆22Updated 7 years ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 5 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 3 years ago
• ramkumarvenkat / kafka-spark-streaming-druid
  Takes a kafka stream into spark, apply transformations and sink into Druid. Everything Dockerised.
  ☆30Updated last year
• simonellistonball / masterclass-hdf
  HDF masterclass materials
  ☆28Updated 9 years ago
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• apache / airflow-ci
  Apache Airflow CI pipeline
  ☆19Updated 5 years ago
• holdenk / spark-intro-ml-pipeline-workshop
  A simple introduction to using spark ml pipelines
  ☆26Updated 7 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago