Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for Apache Airflow (MWAA) on AWS.
☆41Jul 6, 2022Updated 4 years ago
Alternatives and similar repositories for aws-airflow-demo
Users that are interested in aws-airflow-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Sep 1, 2022Updated 3 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆187Jan 26, 2022Updated 4 years ago
- ☆28Jul 26, 2022Updated 4 years ago
- All the basics to get a nice containerized dbt development environment☆58Jun 2, 2022Updated 4 years ago
- jwt rest api using realworld spec and google apps script☆14Jan 5, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Dec 28, 2022Updated 3 years ago
- If you want a progress bar when downloading files in your python app, this is the library for you.☆10May 21, 2024Updated 2 years ago
- Hands-On DevOps with Ansible [Video], Published By Packt☆14Jan 15, 2021Updated 5 years ago
- Work completed through the DataTalksClub Data Engineering ZoomCamp provided by Alexey Grigorev: https://github.com/DataTalksClub/data-eng…☆11Feb 13, 2022Updated 4 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 8 years ago
- This is the code in Python for the first 3 chapters of the book R. Shumway, D. Stoffer - Time Series Analysis and Its Applications.☆19May 18, 2021Updated 5 years ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆119May 28, 2026Updated 2 months ago
- Resources to share for people attending the Innovate AI & ML 2021 Event.☆16Apr 4, 2025Updated last year
- This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) env…☆808Oct 3, 2025Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- dbt / Amazon Redshift Demonstration Project☆35Jan 3, 2023Updated 3 years ago
- Insight Data Engineering project: A platform built in HDFS, Spark and Airflow to help you to find social influencers from GitHub Net…☆16May 21, 2024Updated 2 years ago
- Example on how to export from cloud sql into bigquery, using airflow☆17Dec 16, 2019Updated 6 years ago
- ☆19Mar 28, 2022Updated 4 years ago
- ☆16Jan 2, 2016Updated 10 years ago
- A repository that includes examples from Spanish posts☆10Dec 19, 2025Updated 7 months ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago
- various airflow plugins☆19Dec 26, 2022Updated 3 years ago
- ☆16Jul 25, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example project for building scalable data pipelines with Kedro and Ibis.☆14Dec 10, 2025Updated 7 months ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆17Oct 1, 2019Updated 6 years ago
- External controller to remove terminated EC2 instances from AWS Cloud Map service☆12Mar 24, 2026Updated 4 months ago
- Moving the Amazon Cognito functionality down the stack to the backend. Ideal for migration purposes and extremely custom Auth functionali…☆60Jan 14, 2026Updated 6 months ago
- Configure an outbound email domain for SES using CDK☆16Mar 24, 2022Updated 4 years ago
- Loan Default Prediction using PySpark, with jobs scheduled by Apache Airflow and Integration with Spark using Apache Livy☆22Dec 26, 2020Updated 5 years ago
- 500 Lines or Less 繁體中文翻譯☆11Mar 12, 2019Updated 7 years ago
- Python script to automatically sync new instances via AWS CodeDeploy APIs☆14Jan 14, 2026Updated 6 months ago
- Study materials for the AWS Big Data / Data Analytics Specialty Exam☆27Apr 7, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Infrastructure for researching self-driving databases☆32Jul 2, 2025Updated last year
- This is a repository for immersive learning, meditation or software development.☆57Updated this week
- Integrate AWS IAM with Kubernetes RBAC in an Amazon EKS cluster☆15Jan 15, 2026Updated 6 months ago
- A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs☆47Jun 24, 2026Updated last month
- Android map client built on RxJava☆23Dec 8, 2014Updated 11 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆92Jul 17, 2019Updated 7 years ago
- This workshop is for .NET developers who are interested in restructuring their legacy application into microservices. In this workshop yo…☆17Dec 8, 2022Updated 3 years ago