Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.
☆38Sep 1, 2022Updated 4 years ago
Alternatives and similar repositories for emr-demo
Users that are interested in emr-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Jul 6, 2022Updated 4 years ago
- An AWS based solution using AWS CloudWatch and AWS Lambda based on Python to automatically terminate AWS EMR clusters that have been idle…☆26Jun 5, 2024Updated 2 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆48Jan 7, 2025Updated last year
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Dec 28, 2022Updated 3 years ago
- PySpark testing example project☆13May 28, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆29Dec 22, 2020Updated 5 years ago
- Apache Flink/Apache Kafka streaming data analytics demonstration using Streaming Synthetic Sales Data Generator☆15Jun 4, 2024Updated 2 years ago
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 3 years ago
- (Original: code.google.com/p/pylinda) A Linda implementation in Python.☆14Jun 16, 2022Updated 4 years ago
- dbt / Amazon Redshift Demonstration Project☆35Jan 3, 2023Updated 3 years ago
- A simple command-line tool to copy tables from Amazon Redshift to Amazon RDS (PostgreSQL).☆10Feb 15, 2017Updated 9 years ago
- AWS Glue tutorial for data developers.☆23Sep 2, 2019Updated 7 years ago
- Python script to automatically sync new instances via AWS CodeDeploy APIs☆14Jan 14, 2026Updated 9 months ago
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆10Mar 9, 2022Updated 4 years ago
- ☆13Oct 5, 2019Updated 7 years ago
- Example setup for a Apache Airflow environment to allow for easy development and testing of DAGs using docker compose.☆11Oct 30, 2026Updated last week
- Distributed stock price forecasting system to predict S&P 500 stock prices.☆11Nov 12, 2021Updated 4 years ago
- Rasa Chatbot using Django backend and Sockets for communication☆12Dec 8, 2022Updated 3 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆34Oct 18, 2020Updated 6 years ago
- Java and Android channel client for the Phoenix Framework☆11Nov 1, 2018Updated 8 years ago
- ☆11Sep 1, 2017Updated 9 years ago
- Datasets that can be used as example inputs/outputs for the associated `climate_indices` package☆13May 9, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Aug 21, 2023Updated 3 years ago
- ☆35Dec 12, 2022Updated 3 years ago
- Implementation of trajectory outlier detection methods in C++/Qt5. This methods are TRAOD and iBoat☆13May 28, 2017Updated 9 years ago
- Spark Projects for the Berkeley Data Science Course☆13Aug 12, 2015Updated 11 years ago
- A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).☆19Apr 20, 2024Updated 2 years ago
- Online Anomaly Detection for HPC Performance Data☆11Jun 25, 2018Updated 8 years ago
- a diagnostic tool, in the form of Python library, for pyspark developers to debug and troubleshoot PySpark applications locally☆11Oct 15, 2024Updated 2 years ago
- Power Plant ML Pipeline Application - Apache Spark☆12Dec 12, 2016Updated 9 years ago
- This is the simplified implementation of google maps v2 library☆13Nov 15, 2013Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Marshmallow serializer integration with pyspark☆12Dec 29, 2023Updated 2 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆12May 22, 2018Updated 8 years ago
- This repo provides a managed SageMaker jupyter notebook with a number of notebooks for hands on workshops in data lakes, AI/ML, Batch, Io…☆130Oct 8, 2026Updated 3 weeks ago
- ☆27Dec 17, 2020Updated 5 years ago
- Analyzing Big Data with Amazon EMR☆12Sep 14, 2020Updated 6 years ago
- Code for the post, 'Getting Started with IoT Analytics on AWS'☆14Aug 27, 2020Updated 6 years ago
- Python Tensorflow 2 scripts for detecting objects of any class in an image without knowing their label.☆16Sep 18, 2021Updated 5 years ago