Alternatives and similar repositories for apache-beam-batch-processing

Users that are interested in apache-beam-batch-processing are comparing it to the libraries listed below

• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆56Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated 2 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆86Updated last year
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆86Updated 2 years ago
• datastacktv / apache-beam-explained
  Source code for the YouTube video, Apache Beam Explained in 12 Minutes
  ☆21Updated 4 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆61Updated last year
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• monte-carlo-data / data-downtime-challenge
  ☆86Updated 2 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 5 months ago
• astronomer / webinar-dag-writing-best-practices
  ☆48Updated 3 years ago
• jonathandinu / spark-ray-data-science
  Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …
  ☆52Updated 7 months ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆64Updated 5 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• hotgluexyz / recipes
  Simple samples for writing ETL transform scripts in Python
  ☆24Updated 3 weeks ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• zsvoboda / ngods
  New generation opensource data stack
  ☆71Updated 3 years ago
• spbail / data-quality-tools
  Content for a talk on "The wonderful world of data quality tools in Python"
  ☆18Updated 4 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆148Updated 5 months ago
• dkhundley / ds-quick-tips
  Data Science Quick Tips Repository!
  ☆48Updated last year
• vincentclaes / datajob
  Build and deploy a serverless data pipeline on AWS with no effort.
  ☆111Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• hussein-awala / airflow-duckdb
  A package to run DuckDB queries from Apache Airflow.
  ☆19Updated last year
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 3 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• sizrailev / life-around-data-code
  Code snippets and tools published on the blog at lifearounddata.com
  ☆12Updated 5 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year