Alternatives and similar repositories for data-processing-pipeline:

Users that are interested in data-processing-pipeline are comparing it to the libraries listed below

• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆84Updated 6 years ago
• Yannael / kafka-sparkstreaming-cassandra
  Docker container for Kafka - Spark Streaming - Cassandra
  ☆97Updated 5 years ago
• ftrossbach / intro-to-dcos
  ☆24Updated 6 years ago
• simonellistonball / masterclass-hdf
  HDF masterclass materials
  ☆28Updated 8 years ago
• nadimbahadoor / learn-spark
  Examples To Help You Learn Apache Spark
  ☆77Updated 6 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆52Updated 2 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆48Updated 4 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• yennanliu / spark-etl-pipeline
  Various data stream/batch process demo with Apache Scala Spark 🚀
  ☆11Updated 4 years ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 5 years ago
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆183Updated last year
• ashrithr / LogEventsProcessingSpark
  real time log event processing using spark, kafka & cassandra
  ☆13Updated 10 years ago
• apache-spark-on-k8s / ansible
  Ansible playbooks for Apache Spark on kube
  ☆27Updated 7 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 5 years ago
• hortonworks-gallery / zeppelin-notebooks
  Gallery of Apache Zeppelin notebooks
  ☆215Updated 5 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• IBM / kafka-streaming-click-analysis
  Use Kafka and Apache Spark streaming to perform click stream analytics
  ☆76Updated 4 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• techmonad / spark-data-pipeline
  This project describes how to write full ETL data pipeline using spark.
  ☆15Updated 2 years ago
• phatak-dev / spark2.0-examples
  Examples of Spark 2.0
  ☆211Updated 3 years ago
• mapr-demos / SparkStreamingHBaseExample
  Spark Streaming HBase Example
  ☆22Updated 8 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last year
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• Talend / beam-samples
  ☆81Updated last year
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆123Updated 7 years ago
• NashTech-Labs / Lambda-Arch-Spark
  ☆75Updated 4 years ago