Alternatives and similar repositories for Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3

Users that are interested in Building-a-Data-Lake-with-AWS-Glue-and-Amazon-S3 are comparing it to the libraries listed below

• redapt / pyspark-s3-parquet-example
  This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…
  ☆19Updated 9 years ago
• paiml / awsbigdata
  AWS Big Data Certification
  ☆25Updated 6 months ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 6 months ago
• fastforwardlabs / cml_churn_demo_mlops
  ☆16Updated 2 years ago
• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 8 years ago
• hipic / biz_data_LA
  Business Data Analysis by HiPIC of CalStateLA
  ☆20Updated 6 years ago
• DTAIEB / Thoughtful-Data-Science
  Sample Code for Thoughtful Data Science book
  ☆15Updated 6 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• rich-iannone / so-many-pyspark-examples
  Spark and Python (PySpark) Examples
  ☆39Updated 4 years ago
• AlexIoannides / py-docker-aws-example-project
  Automated testing and deployment of a simple Flask-based (RESTful) micro-service to a production-like environment on AWS, using Docker co…
  ☆43Updated 2 years ago
• ShafiqaIqbal / AWS-Glue-Pyspark-ETL-Job
  A Pyspark job to handle upserts, conversion to parquet and create partitions on S3
  ☆26Updated 4 years ago
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 5 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆88Updated 6 years ago
• RichardAfolabi / Realtime-Data-Analytics-Using-Spark
  Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
  ☆51Updated 8 years ago
• noahgift / pragmaticai
  [Book-2019] Pragmatic AI: An Introduction to Cloud-based Machine Learning
  ☆136Updated 6 months ago
• DFoly / User_log_pipeline
  Creating a Streaming Pipeline for user log data in Google Cloud Platform
  ☆22Updated 5 years ago
• holdenk / spark-intro-ml-pipeline-workshop
  A simple introduction to using spark ml pipelines
  ☆26Updated 7 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 5 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 11 months ago
• GalvanizeDataScience / building-spark-applications-live-lessons
  Supporting content (slides and exercises) for the Addison-Wesley (Pearson) video series covering best practices for developing scalable S…
  ☆67Updated 9 years ago
• quiltdata / quilt-sagemaker-demo
  Example custom model image trainable and distributable via AWS SageMaker
  ☆35Updated 2 years ago
• NYUBigDataProject / SparkClean
  A Scalable Data Cleaning Library for PySpark.
  ☆29Updated 6 years ago
• ksindi / kafka-compose
  Docker compose files for various kafka stacks
  ☆32Updated 7 years ago
• atlanhq / airflow_blog
  Code that goes along with https://humansofdata.atlan.com/2018/06/apache-airflow-disease-outbreaks-india/
  ☆24Updated 2 years ago
• jerry-appliedAIstudio / business-model-simulation
  ☆20Updated 8 years ago
• sugargreenbean / deep-learning-workshop
  ☆18Updated 7 years ago
• PipelineAI / notebooks
  Sample Notebooks for PipelineAI
  ☆44Updated 2 years ago
• frieds / frieds.github.io
  Tutorials & articles on Python, leetcode problems, pandas, and more.
  ☆26Updated 2 years ago
• JasonSanchez / spark-streaming-twitter-kafka
  Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag
  ☆29Updated 9 years ago