Alternatives and similar repositories for apache-beam-batch-processing

Users that are interested in apache-beam-batch-processing are comparing it to the libraries listed below

• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆56Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated 2 years ago
• jonathandinu / spark-ray-data-science
  Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …
  ☆52Updated 7 months ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• datacamp / viewflow
  Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
  ☆126Updated 4 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆20Updated 3 years ago
• datastacktv / apache-beam-explained
  Source code for the YouTube video, Apache Beam Explained in 12 Minutes
  ☆21Updated 4 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆86Updated last year
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 5 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆57Updated 4 months ago
• monte-carlo-data / data-downtime-challenge
  ☆87Updated 2 years ago
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆62Updated last year
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• Klalena / AWS-Serverless-Data-Engineering-Pipeline
  This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I r…
  ☆19Updated 4 years ago
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 6 months ago
• Snowflake-Labs / sfguide-recommender-pipeline
  Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker
  ☆31Updated 4 years ago
• astronomer / airflow-testing-guide
  ☆23Updated 4 years ago
• BogdanCojocar / medium-articles
  Repo for all my code on the articles I post on medium
  ☆107Updated 2 years ago
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆86Updated 2 years ago
• mahdiqb / modern_data_platform
  Sample configuration to deploy a modern data platform.
  ☆88Updated 3 years ago
• adipolak / scaling-machine-learning-course
  Scaling Machine Learning in Three Week course in a collaboration with O'Reilly following the guidance of Adi Polak's book - Scaling Machi…
  ☆23Updated 2 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago
• Spratiher9 / SparkDataset
  Instant search for and access to many datasets in Pyspark.
  ☆34Updated 2 years ago
• priceloop / conventions
  ∞ Priceloop Engineering Conventions for Scala, Python, Git Workflow etc
  ☆100Updated 2 years ago