Alternatives and similar repositories for data-processing-pipeline

Users that are interested in data-processing-pipeline are comparing it to the libraries listed below

• Chabane / bigdata-playground
  A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…
  ☆209Updated 6 years ago
• Yannael / kafka-sparkstreaming-cassandra
  Docker container for Kafka - Spark Streaming - Cassandra
  ☆97Updated 6 years ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 7 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆175Updated 7 months ago
• nadimbahadoor / learn-spark
  Examples To Help You Learn Apache Spark
  ☆78Updated 7 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆52Updated 3 years ago
• dmatrix / examples
  These are some code examples
  ☆56Updated 5 years ago
• jaceklaskowski / spark-workshop
  Apache Spark™ and Scala Workshops
  ☆264Updated last year
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 6 years ago
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆183Updated 2 years ago
• apache-spark-on-k8s / ansible
  Ansible playbooks for Apache Spark on kube
  ☆27Updated 8 years ago
• PacktPublishing / Mastering-Spark-for-Data-Science
  Mastering Spark for Data Science, published by Packt
  ☆49Updated 2 years ago
• mahmoudparsian / big-data-mapreduce-course
  Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
  ☆163Updated last month
• kaantas / spark-twitter-sentiment-analysis
  Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
  ☆55Updated 7 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 6 years ago
• phatak-dev / spark2.0-examples
  Examples of Spark 2.0
  ☆212Updated 4 years ago
• vaquarkhan / Apache-Kafka-poc-and-notes
  ☆248Updated 6 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆70Updated 6 years ago
• trbs / airflow-examples
  ☆29Updated 5 years ago
• eljefe6a / beamexample
  An example Apache Beam project.
  ☆111Updated 8 years ago
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• Pushkr / Apache-Spark-Hands-On
  Educational notes,Hands on problems w/ solutions for hadoop ecosystem
  ☆87Updated 6 years ago
• Talend / beam-samples
  ☆81Updated 2 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆54Updated 2 years ago
• sridharswamy / Twitter-Sentiment-Analysis-Using-Spark-Streaming-And-Kafka
  Twitter Sentiment Analysis using Spark and Kafka
  ☆113Updated 6 years ago
• hortonworks-gallery / zeppelin-notebooks
  Gallery of Apache Zeppelin notebooks
  ☆216Updated 6 years ago
• Mageswaran1989 / awesome-ApacheSpark-collections
  A curated list of awesome Apache Spark packages and resources.
  ☆40Updated 8 years ago
• trK54Ylmz / kafka-spark-streaming-example
  Simple examle for Spark Streaming over Kafka topic
  ☆107Updated 5 years ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 6 years ago
• mahmoudparsian / pyspark-algorithms
  PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
  ☆88Updated 6 years ago