☆17May 16, 2020Updated 6 years ago
Alternatives and similar repositories for AWS-Glue-Pyspark-ETL-Job
Users that are interested in AWS-Glue-Pyspark-ETL-Job are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Jul 23, 2020Updated 6 years ago
- A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help lev…☆20Dec 26, 2022Updated 3 years ago
- ☆14Oct 18, 2020Updated 5 years ago
- Repo with scripts and automation to help ensure best practices in Google Data Catalog☆12Feb 12, 2022Updated 4 years ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Aug 15, 2022Updated 4 years ago
- Hadoop ecosystem connectors for Egeria: repository proxy connector for Apache Atlas.☆21Jun 1, 2024Updated 2 years ago
- Sample code with integration between Data Catalog and BI data sources.☆32Feb 12, 2022Updated 4 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Publish / Deploy a Tabular or Multidimensional Cube to SSAS or AAS☆11Jul 14, 2025Updated last year
- AWS Glue tutorial for data developers.☆23Sep 2, 2019Updated 7 years ago
- An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.☆13Oct 15, 2020Updated 5 years ago
- ☆14Aug 10, 2021Updated 5 years ago
- Run dynamic SQL in SQL. This package allows queries with an unknown number of select-list items and can solve challenging problems like d…☆12Oct 5, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 5 years ago
- ☆13Feb 18, 2022Updated 4 years ago
- Public GitHub repo for SciPy 2022 tutorial (Introduction to Numerical Computing With NumPy)☆13Aug 24, 2022Updated 4 years ago
- These consist of small projects related to core data science skills and most of the projects were done as a part of kaggle competitions☆11Jul 13, 2019Updated 7 years ago
- Social Media Analysis, scalable solution, flexible deployment that analyses social media contents☆10Jul 20, 2023Updated 3 years ago
- Resilient Automation Functions and Scripts☆15Jan 5, 2022Updated 4 years ago
- Helps control infra costs by pointing potential unused zombie Google Cloud Platform projects.☆11Dec 28, 2023Updated 2 years ago
- A code sample that allows you to send a payload from the Twitter API to Google Sheets.☆17Mar 23, 2021Updated 5 years ago
- Parsing, processing, and translation of PostgreSQL, MySQL and ADQL queries☆15Aug 18, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆18Aug 25, 2021Updated 5 years ago
- Node, Express, PostgreSQL, Vue 2 and Graphql CRUD Web App☆12Jun 19, 2025Updated last year
- ☆11Jan 4, 2023Updated 3 years ago
- An example of using Cypress and Gatsby in an automated CI environment (CircleCI)☆10Sep 4, 2019Updated 7 years ago
- ☆25May 1, 2024Updated 2 years ago
- A tutorial on building a real-time data streaming application pipeline with Apache Kafka🔥🔥🔥☆24Apr 29, 2022Updated 4 years ago
- Sample app written with React and built with Babel☆10Aug 26, 2015Updated 11 years ago
- Python utilities for BigQuery analyses.☆15Dec 10, 2020Updated 5 years ago
- This is Jose Portilla Python Data Science course☆12Jul 3, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Build machine learning models with scikit-learn power tools☆11Oct 28, 2022Updated 3 years ago
- Cloud Build for Deploying Datapipelines with Composer, Dataflow and BigQuery☆64Jul 23, 2020Updated 6 years ago
- Model your data using BigQuery views and Jinja templates☆10Dec 8, 2022Updated 3 years ago
- An open source library for BigQuery testing.☆14Jun 22, 2022Updated 4 years ago
- Use a AWS Glue Python Shell Job to connect to your Amazon Redshift cluster and execute a SQL script stored in Amazon S3.☆21Aug 8, 2022Updated 4 years ago
- AWS Lambda function to get events in Kafka topic when files are uploaded to S3☆23Aug 16, 2018Updated 8 years ago
- Kafka Connect: How to create a real time data pipeline using Change Data Capture (CDC)☆13Jan 24, 2021Updated 5 years ago