Alternatives and similar repositories for data-processing-pipeline:

Users that are interested in data-processing-pipeline are comparing it to the libraries listed below

• Yannael / kafka-sparkstreaming-cassandra
  Docker container for Kafka - Spark Streaming - Cassandra
  ☆98Updated 5 years ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 7 years ago
• josephadler / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆28Updated 7 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 5 years ago
• hadooparchitecturebook / clickstream-tutorial
  Code for Tutorial on designing clickstream analytics application using Hadoop
  ☆54Updated 9 years ago
• NashTech-Labs / Lambda-Arch-Spark
  ☆75Updated 4 years ago
• nadimbahadoor / learn-spark
  Examples To Help You Learn Apache Spark
  ☆77Updated 6 years ago
• apache-spark-on-k8s / ansible
  Ansible playbooks for Apache Spark on kube
  ☆27Updated 7 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last year
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆183Updated 2 years ago
• Chabane / bigdata-playground
  A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…
  ☆209Updated 6 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase
  ☆24Updated 8 years ago
• eljefe6a / beamexample
  An example Apache Beam project.
  ☆111Updated 7 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆52Updated 2 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• AllenFang / spark-overflow
  A stack overflow for Apache Spark
  ☆72Updated 7 years ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 7 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• aseigneurin / kafka-sandbox
  ☆48Updated 7 years ago
• techmonad / spark-data-pipeline
  This project describes how to write full ETL data pipeline using spark.
  ☆15Updated 2 years ago
• ashrithr / LogEventsProcessingSpark
  real time log event processing using spark, kafka & cassandra
  ☆13Updated 10 years ago
• instaclustr / sample-KafkaSparkCassandra
  Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.
  ☆23Updated 6 years ago
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 8 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆49Updated 5 years ago
• Mageswaran1989 / awesome-ApacheSpark-collections
  A curated list of awesome Apache Spark packages and resources.
  ☆40Updated 8 years ago