Alternatives and similar repositories for emr-autoscaling:

Users that are interested in emr-autoscaling are comparing it to the libraries listed below

• traviscrawford / spark-dynamodb
  DynamoDB data source for Apache Spark
  ☆95Updated 3 years ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 8 months ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• audienceproject / spark-dynamodb
  Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.
  ☆177Updated 4 years ago
• awslabs / aws-emr-launch
  ☆53Updated last year
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• rdblue / s3committer
  Hadoop output committers for S3
  ☆108Updated 4 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆84Updated 2 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆76Updated 6 years ago
• FINRAOS / herd
  Herd is a managed data lake for the cloud. The Herd unified data catalog helps separate storage from compute in the cloud. Manage petabyt…
  ☆135Updated 2 years ago
• hellonarrativ / spectrify
  Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
  ☆116Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• lynnlangit / Spark-Scala-EKS
  Spark Scala docker container sample for AWS testing - EKS & S3
  ☆24Updated 6 years ago
• zillow / aws-custom-credential-provider
  A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role
  ☆10Updated 7 years ago
• awsdocs / amazon-emr-management-guide
  The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…
  ☆62Updated last year
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆138Updated last month
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• awsdocs / amazon-redshift-management-guide
  The open source version of the Amazon Redshift Cluster Management Guide.
  ☆48Updated last year
• nerdammer / spark-additions
  Utilities for Apache Spark
  ☆34Updated 9 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 3 years ago
• xtream1101 / s3-concat
  Concat multiple files in s3
  ☆39Updated last year
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• guardian / athena-cli
  Presto-like CLI tool for AWS Athena
  ☆85Updated 2 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• laughingman7743 / PyAthenaJDBC
  PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).
  ☆95Updated last year
• josephadler / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆28Updated 7 years ago