Alternatives and similar repositories for apache-beam-batch-processing

Users that are interested in apache-beam-batch-processing are comparing it to the libraries listed below

• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 5 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆57Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆87Updated 3 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated last year
• datastacktv / apache-beam-explained
  Source code for the YouTube video, Apache Beam Explained in 12 Minutes
  ☆21Updated 5 years ago
• jonathandinu / spark-ray-data-science
  Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …
  ☆53Updated last year
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆62Updated last year
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 7 years ago
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆89Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 4 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆58Updated 4 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆84Updated last year
• zsvoboda / ngods
  New generation opensource data stack
  ☆76Updated 3 years ago
• mahdiqb / modern_data_platform
  Sample configuration to deploy a modern data platform.
  ☆89Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 4 years ago
• monte-carlo-data / data-downtime-challenge
  ☆95Updated 2 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆41Updated last year
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆20Updated 4 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆90Updated 4 years ago
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆28Updated 3 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆61Updated 8 months ago
• Spratiher9 / SparkDataset
  Instant search for and access to many datasets in Pyspark.
  ☆34Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆151Updated 11 months ago
• Snowflake-Labs / sfguide-recommender-pipeline
  Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker
  ☆32Updated 4 years ago
• spbail / data-quality-tools
  Content for a talk on "The wonderful world of data quality tools in Python"
  ☆18Updated 4 years ago
• astronomer / webinar-dag-writing-best-practices
  ☆49Updated 4 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆89Updated 6 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆66Updated 5 years ago