Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.
☆38Sep 1, 2022Updated 3 years ago
Alternatives and similar repositories for emr-demo
Users that are interested in emr-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Jul 6, 2022Updated 4 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆48Jan 7, 2025Updated last year
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Dec 28, 2022Updated 3 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆14Oct 26, 2021Updated 4 years ago
- ☆17Oct 15, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 2 years ago
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆29Dec 22, 2020Updated 5 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆18Sep 17, 2018Updated 7 years ago
- Real-time crypto-currency dashboard☆10May 25, 2017Updated 9 years ago
- My applied big data analytic project with pyspark.☆10Sep 21, 2022Updated 3 years ago
- Agile database integration tests with Python, SQLAlchemy and Factory Boy☆11Mar 17, 2018Updated 8 years ago
- ☆13Oct 5, 2019Updated 6 years ago
- Access Amazon MSK from Amazon EKS using Terraform and Helm.☆24Jul 27, 2021Updated 5 years ago
- A collection of data analysis projects done using PySpark via Jupyter notebooks.☆10Oct 8, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A python implementation of PROCLUS: PROjected CLUStering algorithm.☆10Jan 12, 2015Updated 11 years ago
- Rasa Chatbot using Django backend and Sockets for communication☆12Dec 8, 2022Updated 3 years ago
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- a list of links to help you make various important architectural decisions☆11Jul 13, 2016Updated 10 years ago
- ☆14Sep 14, 2021Updated 4 years ago
- an improved matlab -nodesktop☆11Apr 17, 2020Updated 6 years ago
- Distributed stock price forecasting system to predict S&P 500 stock prices.☆11Nov 12, 2021Updated 4 years ago
- Power Plant ML Pipeline Application - Apache Spark☆12Dec 12, 2016Updated 9 years ago
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆10Mar 9, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆35Dec 12, 2022Updated 3 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆34Oct 18, 2020Updated 5 years ago
- Online Anomaly Detection for HPC Performance Data☆11Jun 25, 2018Updated 8 years ago
- Datasets that can be used as example inputs/outputs for the associated `climate_indices` package☆13May 9, 2019Updated 7 years ago
- ☆11Aug 21, 2023Updated 2 years ago
- Implementation of trajectory outlier detection methods in C++/Qt5. This methods are TRAOD and iBoat☆13May 28, 2017Updated 9 years ago
- ☆11Mar 12, 2026Updated 5 months ago
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated 7 months ago
- Gotta stay sharp! Common algorithms and puzzles implemented in C, Java, and Python.☆16Jan 13, 2015Updated 11 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆12Feb 11, 2022Updated 4 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 8 years ago
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Jun 16, 2020Updated 6 years ago
- Run a Spark job within Amazon EMR☆12Sep 12, 2020Updated 5 years ago
- Language Translation and Syntax Tool Made With React Using AWS Amplify Predictions Library to Integrate Artificial Intelligence and Machi…☆11Jun 27, 2022Updated 4 years ago
- This is a pipeline of an ETL application in GCP with open airport code data, which you can find here: https://datahub.io/core/airport-cod…☆18Nov 15, 2021Updated 4 years ago
- Marshmallow serializer integration with pyspark☆12Dec 29, 2023Updated 2 years ago