Alternatives and similar repositories for apache-beam-batch-processing

Users that are interested in apache-beam-batch-processing are comparing it to the libraries listed below

• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆54Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated 2 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆85Updated last year
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 11 months ago
• jonathandinu / spark-ray-data-science
  Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …
  ☆52Updated 6 months ago
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆86Updated 2 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• monte-carlo-data / data-downtime-challenge
  ☆86Updated 2 years ago
• MBKraus / incremental_training
  Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'
  ☆121Updated 2 years ago
• ds-muzalevskiy / sagemaker-docker-deploy
  ☆18Updated 3 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆70Updated 3 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago
• adipolak / scaling-machine-learning-course
  Scaling Machine Learning in Three Week course in a collaboration with O'Reilly following the guidance of Adi Polak's book - Scaling Machi…
  ☆23Updated 2 years ago
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 5 years ago
• astronomer / airflow-testing-guide
  ☆23Updated 4 years ago
• astronomer / webinar-dag-writing-best-practices
  ☆48Updated 3 years ago
• feast-dev / feast-aws-credit-scoring-tutorial
  Feast AWS guide using Redshift / Spectrum / DynamoDB to build a credit scoring model
  ☆65Updated 3 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 3 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆63Updated 5 years ago
• datastacktv / apache-beam-explained
  Source code for the YouTube video, Apache Beam Explained in 12 Minutes
  ☆21Updated 4 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆153Updated 5 months ago
• great-expectations / great_expectations_action
  A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.
  ☆80Updated last year
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆57Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆138Updated 4 months ago