RealKinetic / aws-glue-pipeline-example
An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.
☆12Updated 4 years ago
Alternatives and similar repositories for aws-glue-pipeline-example:
Users that are interested in aws-glue-pipeline-example are comparing it to the libraries listed below
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Updated 4 years ago
- Snowflake Cookbook, published by Packt☆76Updated 2 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆43Updated 5 years ago
- ☆34Updated 2 years ago
- code snippet for analytics sessions☆33Updated 2 years ago
- Udacity Data Engineer Nano Degree - Project-3 (Data Warehouse)☆22Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Unit testing using databricks connect☆30Updated 3 years ago
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆15Updated 6 years ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆42Updated last month
- Git repo to accompany the AWS DevOps Blog: Using AWS DevOps Tools to model and provision AWS Glue workflows☆19Updated 3 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11Updated 6 years ago
- Repository for AWS Glue Workshop☆31Updated 2 years ago
- Serverless ETL and Analytics with AWS Glue, published by Packt☆46Updated last year
- Repository of notebooks and related collateral used in the Databricks Demo Hub, showing how to use Databricks, Delta Lake, MLflow, and mo…☆25Updated 3 years ago
- ☆17Updated 4 years ago
- Data Engineering with AWS Cookbook, published by Packt☆13Updated last month
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆49Updated last year
- ☆53Updated 4 years ago
- ☆117Updated 3 months ago
- ☆51Updated 9 months ago
- All the Snowflake Virtual Warehouse - Example☆11Updated 4 years ago
- ☆25Updated last year
- Quickstart: Getting Started with Snowpark Python☆32Updated 2 years ago
- build dw with dbt☆35Updated 3 months ago
- Azure Data Engineering Cookbook 2nd-edition, published by Packt☆31Updated last year
- Materials for the next course☆24Updated last year
- Ravi Azure ADB ADF Repository☆65Updated this week
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆40Updated 2 years ago