datastacktv / apache-beam-explained
Source code for the YouTube video, Apache Beam Explained in 12 Minutes
☆21Updated 4 years ago
Alternatives and similar repositories for apache-beam-explained:
Users that are interested in apache-beam-explained are comparing it to the libraries listed below
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- ☆20Updated 5 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 3 years ago
- Building Big Data Pipelines with Apache Beam, published by Packt☆86Updated 2 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆13Updated last year
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- Code examples for the Introduction to Kubeflow course☆14Updated 4 years ago
- ☆53Updated 8 months ago
- Materials for the next course☆24Updated 2 years ago
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆67Updated 11 months ago
- ☆36Updated 2 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆66Updated 3 years ago
- AWS Big Data Certification☆25Updated 3 months ago
- Stream Processing Workshop☆22Updated 8 months ago
- Sample Airflow DAGs☆62Updated 2 years ago
- Airflow helm chart for AWS EKS☆18Updated 4 years ago
- Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow☆13Updated 3 years ago
- This repository contains recipes for Apache Pinot.☆30Updated last month
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- Cassandra + Spark = ❤️ Machine Learning with Apache Spark & Cassandra☆20Updated 3 years ago
- Python and AirFlow - Data Pipeline Orchestration☆17Updated last year
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Library which aim to generate kubernetes yamls templates from an Airflow dag using the Airflow Kuberntes Pod Operator☆10Updated 3 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 3 months ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated 11 months ago
- Code that was used as an example during the Data+AI Summit 2020☆15Updated 4 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Supplementary material for Building a Modern Data Platform with Snowflake, from Pearson.☆21Updated 3 years ago
- ☆73Updated 2 months ago