An AWS based solution using AWS CloudWatch and AWS Lambda based on Python to automatically terminate AWS EMR clusters that have been idle for a specified period of time.
☆26Jun 5, 2024Updated 2 years ago
Alternatives and similar repositories for aws-auto-terminate-idle-emr
Users that are interested in aws-auto-terminate-idle-emr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Sep 1, 2022Updated 4 years ago
- My applied big data analytic project with pyspark.☆10Sep 21, 2022Updated 4 years ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- A data engineering pipeline for digital marketers.☆11Dec 21, 2018Updated 7 years ago
- Chef cookbook for Titan distributed graph database (embedded w/ cassandra + elastic search)☆17Dec 10, 2014Updated 11 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Distributed stock price forecasting system to predict S&P 500 stock prices.☆11Nov 12, 2021Updated 4 years ago
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆10Mar 9, 2022Updated 4 years ago
- A fast and low memory requirement version of PointHop and PointHop++, which is built upon Apache Spark.☆10Jul 14, 2020Updated 6 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 8 years ago
- Run a Spark job within Amazon EMR☆12Sep 12, 2020Updated 6 years ago
- Analyzing Big Data with Amazon EMR☆12Sep 14, 2020Updated 6 years ago
- Marshmallow serializer integration with pyspark☆12Dec 29, 2023Updated 2 years ago
- Methods for mapping proteomics data on 3D protein structure.☆15Jan 18, 2020Updated 6 years ago
- Analysis of City Of Chicago Taxi Trip Dataset Using AWS EMR, Spark, PySpark, Zeppelin and Airbnb's Superset☆15Jul 16, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mobile robot data were analyzed with Apache-Spark to extract five different statistical result such as travel time, waiting time, average…☆15Apr 5, 2022Updated 4 years ago
- Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotli…☆17Dec 3, 2018Updated 7 years ago
- Multi-Class Classification | Transfer Learning With PySpark☆13Nov 12, 2019Updated 6 years ago
- Analytics projects using Big Data eco-systems (Hadoop, Spark, Storm)☆17Dec 27, 2021Updated 4 years ago
- GaanaSuno is an application that lets users upload, store and play all of your music from the cloud. Additionally, a user can comment and…☆12Aug 18, 2018Updated 8 years ago
- Amazon EMR on EKS Custom Image CLI☆32Sep 26, 2024Updated last year
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆54Dec 12, 2018Updated 7 years ago
- Time Series Anomaly detection. The monitored signal is made-up of machinery vibration sensor measurements.☆18Dec 7, 2020Updated 5 years ago
- Notify Alert to Google Chat Gsuite☆11Mar 31, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- pyspark dataframe made easy☆16Dec 15, 2021Updated 4 years ago
- A k3s packager and installer, primarily intended for airgapped deployments☆13Jan 25, 2021Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56May 6, 2023Updated 3 years ago
- scala and spark examples project☆14Feb 19, 2018Updated 8 years ago
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆20Aug 5, 2022Updated 4 years ago
- Collection of Databricks and Jupyter Notebooks☆22Feb 9, 2026Updated 7 months ago
- Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.☆21Jan 30, 2019Updated 7 years ago
- Challenge to job: Data Scientist☆16Jan 10, 2022Updated 4 years ago
- Infrastructure setup.☆10Jul 27, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Example of building a Windows Server 2016 AMI for EC2 using Packer☆12Sep 6, 2018Updated 8 years ago
- This is an experimental project that seeks to integrate PySpark and xarray for Climate Data Analysis.☆21Nov 16, 2017Updated 8 years ago
- ☆15Sep 12, 2026Updated last week
- Step by step instructions on how to use the Jenkins Kubernetes plugin for different use cases.☆11Aug 9, 2019Updated 7 years ago
- Re-key Salt masters and minions☆11May 14, 2020Updated 6 years ago
- Performed Aspect Based Sentiment Analysis using Topic Modeling(LDA) and sentiment analysis and Regression analysis using Python and Spark…☆19Feb 6, 2018Updated 8 years ago
- A Scalable Data Cleaning Library for PySpark.☆29Apr 4, 2019Updated 7 years ago