Alternatives and similar repositories for emr-autoscaling:

Users that are interested in emr-autoscaling are comparing it to the libraries listed below

• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 4 years ago
• audienceproject / spark-dynamodb
  Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.
  ☆177Updated 3 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• traviscrawford / spark-dynamodb
  DynamoDB data source for Apache Spark
  ☆95Updated 3 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆76Updated 6 years ago
• rdblue / s3committer
  Hadoop output committers for S3
  ☆108Updated 4 years ago
• hortonworks / hive-json
  A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.
  ☆42Updated last year
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆84Updated 2 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆86Updated 10 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• hammerlab / yarn-logs-helpers
  Scripts for parsing / making sense of yarn logs
  ☆52Updated 8 years ago
• nerdammer / spark-additions
  Utilities for Apache Spark
  ☆34Updated 8 years ago
• qubole / spark-on-lambda
  Apache Spark on AWS Lambda
  ☆151Updated 2 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• awslabs / kinesis-kafka-connector
  kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.
  ☆154Updated last year
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 6 months ago
• awslabs / aws-emr-launch
  ☆53Updated last year
• FreckleIOT / ecs-airflow
  Cloudformation templates for deploying Airflow in ECS
  ☆40Updated 6 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• hellonarrativ / spectrify
  Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
  ☆116Updated 2 years ago
• snowplow-archive / spark-example-project
  A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
  ☆118Updated 8 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 3 years ago
• awslabs / aws-glue-catalog-sync-agent-for-hive
  Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog
  ☆34Updated last year
• zillow / aws-custom-credential-provider
  A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role
  ☆10Updated 7 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• awsdocs / amazon-emr-management-guide
  The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…
  ☆60Updated last year
• xtream1101 / s3-concat
  Concat multiple files in s3
  ☆39Updated last year
• guardian / athena-cli
  Presto-like CLI tool for AWS Athena
  ☆85Updated 2 years ago