Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.
☆38Sep 1, 2022Updated 4 years ago
Alternatives and similar repositories for emr-demo
Users that are interested in emr-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Jul 6, 2022Updated 4 years ago
- Amazon EMR Serverless and Amazon MSK Serverless Demo☆13Jul 31, 2022Updated 4 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 10 months ago
- An AWS based solution using AWS CloudWatch and AWS Lambda based on Python to automatically terminate AWS EMR clusters that have been idle…☆26Jun 5, 2024Updated 2 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆48Jan 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Dec 28, 2022Updated 3 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆14Oct 26, 2021Updated 4 years ago
- ☆16Oct 15, 2020Updated 5 years ago
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 2 years ago
- AWS Glue tutorial for data developers.☆23Sep 2, 2019Updated 7 years ago
- Python script to automatically sync new instances via AWS CodeDeploy APIs☆14Jan 14, 2026Updated 8 months ago
- My applied big data analytic project with pyspark.☆10Sep 21, 2022Updated 4 years ago
- ☆13Oct 5, 2019Updated 6 years ago
- Angular 12-based front-end UI for k8s Golang observability project: https://github.com/garystafford/k8s-istio-observe-backend/tree/2021-i…☆25Jul 15, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Rasa Chatbot using Django backend and Sockets for communication☆12Dec 8, 2022Updated 3 years ago
- a list of links to help you make various important architectural decisions☆11Jul 13, 2016Updated 10 years ago
- A React component to implement continuous scrolling (for modern browser).☆16Jan 12, 2017Updated 9 years ago
- ☆14Sep 14, 2021Updated 5 years ago
- Access Amazon MSK from Amazon EKS using Terraform and Helm.☆25Jul 27, 2021Updated 5 years ago
- Distributed stock price forecasting system to predict S&P 500 stock prices.☆11Nov 12, 2021Updated 4 years ago
- Power Plant ML Pipeline Application - Apache Spark☆12Dec 12, 2016Updated 9 years ago
- PredictorFinc is a scalable supervised machine learning model the predicts stock price change through Decision Tree Regressor using data …☆12Sep 5, 2023Updated 3 years ago
- Data science, machine learning tools on the cloud☆15Jan 13, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆35Dec 12, 2022Updated 3 years ago
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆10Mar 9, 2022Updated 4 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆34Oct 18, 2020Updated 5 years ago
- A project for the development of rich geospatial data from the city of São Paulo for use in Machine Learning models.☆12Jul 4, 2021Updated 5 years ago
- Implementation of trajectory outlier detection methods in C++/Qt5. This methods are TRAOD and iBoat☆13May 28, 2017Updated 9 years ago
- Deeper look into access control and data lake configuration☆33Apr 13, 2022Updated 4 years ago
- ☆11Mar 12, 2026Updated 6 months ago
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated 8 months ago
- Gotta stay sharp! Common algorithms and puzzles implemented in C, Java, and Python.☆16Jan 13, 2015Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Feb 11, 2022Updated 4 years ago
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Jun 16, 2020Updated 6 years ago
- This repo provides a managed SageMaker jupyter notebook with a number of notebooks for hands on workshops in data lakes, AI/ML, Batch, Io…☆130Aug 27, 2026Updated last month
- Analyzing Big Data with Amazon EMR☆12Sep 14, 2020Updated 6 years ago
- Language Translation and Syntax Tool Made With React Using AWS Amplify Predictions Library to Integrate Artificial Intelligence and Machi…☆11Jun 27, 2022Updated 4 years ago
- This is a pipeline of an ETL application in GCP with open airport code data, which you can find here: https://datahub.io/core/airport-cod…☆18Nov 15, 2021Updated 4 years ago
- It is an android app that allows users to load image from gallery and segment the image using watershed transform.The segmented image is …☆10Mar 20, 2015Updated 11 years ago