☆17May 16, 2020Updated 6 years ago
Alternatives and similar repositories for AWS-Glue-Pyspark-ETL-Job
Users that are interested in AWS-Glue-Pyspark-ETL-Job are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆27Jul 23, 2020Updated 5 years ago
- A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help lev…☆20Dec 26, 2022Updated 3 years ago
- ☆14Oct 18, 2020Updated 5 years ago
- Repo with scripts and automation to help ensure best practices in Google Data Catalog☆13Feb 12, 2022Updated 4 years ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The open source version of the Amazon EMR Release Guide. You can submit feedback & requests for changes by submitting issues in this repo…☆29Jun 15, 2023Updated 2 years ago
- Sample code with integration between Data Catalog and BI data sources.☆32Feb 12, 2022Updated 4 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 3 years ago
- ☆18Aug 15, 2022Updated 3 years ago
- An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.☆13Oct 15, 2020Updated 5 years ago
- AWS Glue tutorial for data developers.☆23Sep 2, 2019Updated 6 years ago
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 5 years ago
- Social Media Analysis, scalable solution, flexible deployment that analyses social media contents☆10Jul 20, 2023Updated 2 years ago
- Resilient Automation Functions and Scripts☆15Jan 5, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Run dynamic SQL in SQL. This package allows queries with an unknown number of select-list items and can solve challenging problems like d…☆12Oct 5, 2024Updated last year
- Building pipeline to process the real-time data using Spark and Mongodb.☆12Oct 30, 2019Updated 6 years ago
- Example source code and projects for the Looker SDKs☆44Jul 30, 2021Updated 4 years ago
- ☆13Dec 9, 2022Updated 3 years ago
- Instruments code for collecting data coverage (instead of code coverage)☆10May 5, 2017Updated 9 years ago
- Snowflake demo for Financial Services☆21May 5, 2025Updated last year
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆18Aug 25, 2021Updated 4 years ago
- Node, Express, PostgreSQL, Vue 2 and Graphql CRUD Web App☆12Jun 19, 2025Updated 11 months ago
- ☆11Jan 4, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25May 1, 2024Updated 2 years ago
- An example of using Cypress and Gatsby in an automated CI environment (CircleCI)☆10Sep 4, 2019Updated 6 years ago
- A tutorial on building a real-time data streaming application pipeline with Apache Kafka🔥🔥🔥☆24Apr 29, 2022Updated 4 years ago
- Helps control infra costs by pointing potential unused zombie Google Cloud Platform projects.☆11Dec 28, 2023Updated 2 years ago
- Model your data using BigQuery views and Jinja templates☆10Dec 8, 2022Updated 3 years ago
- Build machine learning models with scikit-learn power tools☆11Oct 28, 2022Updated 3 years ago
- Sample app written with React and built with Babel☆10Aug 26, 2015Updated 10 years ago
- Cloud Build for Deploying Datapipelines with Composer, Dataflow and BigQuery☆64Jul 23, 2020Updated 5 years ago
- AWS Lambda function to get events in Kafka topic when files are uploaded to S3☆23Aug 16, 2018Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Commons code used by the Data Catalog connectors, and links for the connectors sample code.☆61Nov 24, 2021Updated 4 years ago
- A FinServ microservice DevOps blueprint to kickstart a successful software development workflow on Google Cloud Plataform and Github Thi…☆10Jul 11, 2022Updated 3 years ago
- Snippets of code used in blog posts and other media.☆13Nov 11, 2025Updated 6 months ago
- Code snippets used for http://thisdataguy.com☆14Oct 13, 2020Updated 5 years ago
- Kafka Connect: How to create a real time data pipeline using Change Data Capture (CDC)☆13Jan 24, 2021Updated 5 years ago
- Simplified Unit Testing Framework for Angular☆11Jan 5, 2023Updated 3 years ago
- Contains example dags and terraform code to create a composer with a node pool to run pods☆13Oct 15, 2020Updated 5 years ago