jacobceles / intro-to-colab-pyspark-emr
A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics like EMR sizing, Google Colaboratory, fine-tuning PySpark jobs, and much more.
☆20Updated 3 years ago
Alternatives and similar repositories for intro-to-colab-pyspark-emr:
Users that are interested in intro-to-colab-pyspark-emr are comparing it to the libraries listed below
- Instant search for and access to many datasets in Pyspark.☆34Updated 2 years ago
- Use Multiple Linear Regression, Python, Pandas, and Matplotlib to analyze the lifetime value and the key factors of the ‘Telco Customer C…☆10Updated 4 years ago
- ☆18Updated 3 years ago
- ☆18Updated 6 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆16Updated 4 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Operations Research Algorithms☆17Updated last year
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆53Updated 3 years ago
- Demo on how to use Prefect with Docker☆25Updated 2 years ago
- Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple …☆29Updated 4 years ago
- ☆19Updated 4 years ago
- Book Projects☆24Updated 4 years ago
- This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…☆15Updated 4 years ago
- Deploy A/B testing infrastructure in a containerized microservice architecture for Machine Learning applications.☆40Updated 3 months ago
- ☆21Updated last year
- Create a local dashboard to visualize and filter your GitHub feed☆29Updated 2 years ago
- Essential PySpark for Scalable Data Analytics, published by Packt☆44Updated 2 years ago
- ☆84Updated 2 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆16Updated last year
- code, labs and lectures for the course☆46Updated last year
- This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I r…☆19Updated 4 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆97Updated 8 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- datascienv is package that helps you to setup your environment in single line of code with all dependency and it is also include pyforest…☆58Updated 3 years ago
- A very simple "hello world" project for deploying Prefect 2 to a docker container on Google Compute Engine.☆11Updated 2 years ago
- Streamlit example showing Scikit Learn & Pyspark ML over Healthcare data ! Its simple !!☆30Updated 4 years ago
- Full stack data engineering tools and infrastructure set-up☆50Updated 4 years ago
- Best practices for engineering ML pipelines.☆35Updated 2 years ago
- Big Data Demystified meetup and blog examples☆31Updated 7 months ago
- Demo on how to use Prefect 2 in an ML project☆41Updated 2 years ago