ecloudvalley / Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3
☆17Updated 6 years ago
Alternatives and similar repositories for Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3
Users that are interested in Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3 are comparing it to the libraries listed below
Sorting:
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 9 years ago
- AWS Big Data Certification☆25Updated 4 months ago
- ☆16Updated 2 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Sample Code for Thoughtful Data Science book☆15Updated 6 years ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Business Data Analysis by HiPIC of CalStateLA☆20Updated 6 years ago
- Spark and Python (PySpark) Examples☆39Updated 3 years ago
- In this workshop you will launch an Amazon Redshift cluster in your AWS account and load sample data ~ 100GB using TPCH dataset. You will…☆25Updated 6 years ago
- ☆26Updated last year
- Code repository for Effective Amazon Machine Learning, published by Packt☆13Updated 2 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Updated 4 years ago
- ☆16Updated 7 years ago
- ☆30Updated last year
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Source code for 'PySpark Recipes' by Raju Kumar Mishra☆25Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 6 years ago
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- ☆16Updated 4 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Updated this week
- A curated list of awesome Databricks resources, including Spark☆18Updated 10 months ago
- Code and setup information for Introduction to Machine Learning with Spark☆12Updated 9 years ago
- A simple introduction to using spark ml pipelines☆26Updated 7 years ago
- ☆52Updated 7 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- A python package to create a database on the platform using our moj data warehousing framework☆21Updated 8 months ago
- PySpark phonetic and string matching algorithms☆39Updated last year
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- DataHub on AWS demonstration resources☆10Updated 2 years ago