ecloudvalley / Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3
☆17Updated 6 years ago
Alternatives and similar repositories for Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3:
Users that are interested in Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3 are comparing it to the libraries listed below
- AWS Big Data Certification☆25Updated 2 months ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Updated 4 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Creating a Streaming Pipeline for user log data in Google Cloud Platform☆22Updated 5 years ago
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Updated this week
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 6 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 2 months ago
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆62Updated 6 years ago
- Git repo to accompany the AWS DevOps Blog: Using AWS DevOps Tools to model and provision AWS Glue workflows☆19Updated 3 years ago
- ☆30Updated last year
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆40Updated 2 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆51Updated 8 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- ☆27Updated 4 years ago
- ☆34Updated 2 years ago
- ☆52Updated 7 years ago
- AWS CloudFormation and SAM templates for machine learning inference with AWS Lambda.☆19Updated 4 years ago
- AWS Quick Start Team☆23Updated 5 months ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Big Data Demystified meetup and blog examples☆31Updated 7 months ago
- Build and run Spark Structured Streaming pipelines in Hadoop - project using PySpark.☆13Updated 5 years ago
- Contains source files used in the Spark with Python course☆18Updated 5 years ago
- ☆16Updated last year
- A python package to create a database on the platform using our moj data warehousing framework☆21Updated 6 months ago
- Business Data Analysis by HiPIC of CalStateLA☆20Updated 6 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- ☆52Updated 6 years ago