mozilla / emr-bootstrap-spark
AWS bootstrap scripts for Mozilla's flavoured Spark setup.
☆47Updated 5 years ago
Alternatives and similar repositories for emr-bootstrap-spark:
Users that are interested in emr-bootstrap-spark are comparing it to the libraries listed below
- DynamoDB data source for Apache Spark☆95Updated 3 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated last year
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.☆28Updated 7 years ago
- ☆54Updated 7 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Amazon Elastic MapReduce code samples☆63Updated 9 years ago
- Kinesis spout for Storm☆106Updated 7 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 4 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 9 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 8 months ago
- functionstest☆33Updated 8 years ago
- Tool for exploring data on an Apache Kafka cluster☆42Updated 4 years ago
- Reference architecture for real-time stream processing with Apache Flink on Amazon EMR, Amazon Kinesis, and Amazon Elasticsearch Service.☆71Updated last year
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆118Updated 9 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆87Updated 4 years ago
- Scripts and instructions to facilitate running Deep Learning Tasks on Amazon EMR☆63Updated last year
- The Scalding tutorial as a standalone SBT project☆51Updated 7 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 3 weeks ago
- Spark to Tableau Extractor library☆18Updated 7 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.☆42Updated last year
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago