Alternatives and similar repositories for spark-streaming-pyspark

Users that are interested in spark-streaming-pyspark are comparing it to the libraries listed below

• godatadriven-dockerhub / hive-metastore
  Hadoop/Hive/Spark container to perform CI tests
  ☆11Updated 4 years ago
• NeerajBhadani / spark-streaming
  This repository contains code for Spark Streaming
  ☆22Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆44Updated 2 years ago
• abhishek-ch / data-machinelearning-the-boring-way
  Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.
  ☆57Updated 2 years ago
• polyzos / stream-processing-with-apache-flink
  ☆57Updated 10 months ago
• stream-processing-with-spark / notebooks
  Interactive Notebooks that support the book
  ☆40Updated 4 years ago
• jaehyeon-kim / dbt-on-aws
  dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats
  ☆29Updated 2 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• avensolutions / spark-sql-etl-framework
  Multi-stage, config driven, SQL based ETL framework using PySpark
  ☆25Updated 5 years ago
• rogeriomm / labtools-k8s
  Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…
  ☆28Updated 2 weeks ago
• mrn-aglic / apache-iceberg-data-exploration
  ☆18Updated last year
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated this week
• fastforwardlabs / cml_churn_demo_mlops
  ☆16Updated 2 years ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated this week
• masfworld / cdc_deltaLake
  Docker compose and Google Colab demo to build a CDC with Delta Lake
  ☆15Updated 2 years ago
• sahilbhange / hive-sql-slowly-changing-dimension
  Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…
  ☆16Updated 6 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• paiml / awsbigdata
  AWS Big Data Certification
  ☆25Updated 4 months ago
• garystafford / aws-airflow-demo
  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…
  ☆41Updated 2 years ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 4 months ago
• mahdiqb / modern_data_platform
  Sample configuration to deploy a modern data platform.
  ☆88Updated 3 years ago
• jaehyeon-kim / flink-demos
  Apache Flink (Pyflink) and Related Projects
  ☆39Updated last month
• webysther / aws-glue-docker
  🐋 Docker image for AWS Glue Spark/Python
  ☆23Updated last year
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• cloudera-labs / edge2ai-workshop
  ☆30Updated 3 weeks ago
• streamsets / pipeline-library
  Pipeline library for StreamSets Data Collector and Transformer
  ☆33Updated 2 years ago
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 4 years ago