datastacktv / apache-beam-batch-processing

Related projects ⓘ

Alternatives and complementary repositories for apache-beam-batch-processing

• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆13Updated 3 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆44Updated 3 years ago
• InfuseAI / taxi_rides_ny_duckdb
  PipeRider dbt workshop for DataTalksClub DE Zoomcamp
  ☆16Updated 11 months ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆83Updated last year
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 4 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆40Updated last week
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 4 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆50Updated 3 months ago
• datastacktv / apache-beam-explained
  Source code for the YouTube video, Apache Beam Explained in 12 Minutes
  ☆20Updated 4 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 6 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆42Updated 8 months ago
• uplimit / course-dbt
  Analytics engineering with dbt - projects and developer environment
  ☆16Updated last month
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 3 months ago
• Klalena / AWS-Serverless-Data-Engineering-Pipeline
  This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I r…
  ☆19Updated 3 years ago
• Beam-College / season-2022
  ☆36Updated 2 years ago
• velascoluis / dbt-ci-cd-gke
  CICD pipeline that deploys a dbt image on a GKE cluster
  ☆11Updated 3 years ago
• PacktPublishing / Amazon-Redshift-Cookbook
  Amazon Redshift Cookbook, Published by Packt
  ☆15Updated last year
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆46Updated last year
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆24Updated last year
• fastforwardlabs / cml_churn_demo_mlops
  ☆16Updated last year
• san089 / Optimizing-Public-Transportation
  A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
  ☆29Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆41Updated 3 months ago
• adipolak / scaling-machine-learning-course
  Scaling Machine Learning in Three Week course in a collaboration with O'Reilly following the guidance of Adi Polak's book - Scaling Machi…
  ☆23Updated last year
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆18Updated 3 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆83Updated 6 months ago
• monte-carlo-data / data-downtime-challenge
  ☆83Updated last year
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year