jacobceles / intro-to-colab-pyspark-emr
A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics like EMR sizing, Google Colaboratory, fine-tuning PySpark jobs, and much more.
☆20Updated 3 years ago
Alternatives and similar repositories for intro-to-colab-pyspark-emr:
Users that are interested in intro-to-colab-pyspark-emr are comparing it to the libraries listed below
- ☆19Updated 6 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆16Updated 4 years ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆26Updated 2 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆95Updated 6 months ago
- Instant search for and access to many datasets in Pyspark.☆34Updated 2 years ago
- ☆18Updated 3 years ago
- A guide to show you how to import data for ETL☆20Updated 2 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆14Updated 10 months ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Operations Research Algorithms☆17Updated 10 months ago
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆53Updated 3 years ago
- ☆87Updated 2 years ago
- ☆21Updated last year
- Use Multiple Linear Regression, Python, Pandas, and Matplotlib to analyze the lifetime value and the key factors of the ‘Telco Customer C…☆10Updated 4 years ago
- PySpark Cheatsheet☆36Updated 2 years ago
- pyspark dataframe made easy☆16Updated 3 years ago
- code snippet for analytics sessions☆33Updated 2 years ago
- Demo on how to use Prefect with Docker☆25Updated 2 years ago
- Deploy A/B testing infrastructure in a containerized microservice architecture for Machine Learning applications.☆40Updated last month
- Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple …☆29Updated 4 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆16Updated 6 years ago
- ☆12Updated 4 years ago
- Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.☆55Updated 2 years ago
- Essential PySpark for Scalable Data Analytics, published by Packt☆43Updated 2 years ago
- ☆19Updated 3 years ago
- streaming eight subreddits from reddit api using kafka producer & spark structured streaming.☆19Updated 3 months ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆39Updated last year
- GitHub repository related to the course Mastering Elastic Map Reduce for Data Engineers☆25Updated 2 years ago
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- Best practices for engineering ML pipelines.☆37Updated 2 years ago