Alternatives and similar repositories for spark-kafka-writer

Users that are interested in spark-kafka-writer are comparing it to the libraries listed below

• tresata / spark-kafka

  View on GitHub
  Low level integration of Spark and Kafka
  ☆130Mar 15, 2018Updated 7 years ago
• mkuthan / example-spark-kafka

  View on GitHub
  Apache Spark and Apache Kafka integration example
  ☆124Dec 21, 2017Updated 8 years ago
• hortonworks-spark / spark-schema-registry

  View on GitHub
  Schema Registry integration for Apache Spark
  ☆40Nov 16, 2022Updated 3 years ago
• ansrivas / spark-structured-streaming

  View on GitHub
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆63Dec 5, 2019Updated 6 years ago
• japila-books / spark-structured-streaming-internals

  View on GitHub
  The Internals of Spark Structured Streaming
  ☆422Jan 25, 2026Updated 3 weeks ago
• polomarcus / Spark-Structured-Streaming-Examples

  View on GitHub
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆186Feb 7, 2023Updated 3 years ago
• jerryshao / spark-kafka-0-8-sql

  View on GitHub
  Spark Structured Streaming Kafka 0.8 Source Implementation
  ☆35Apr 27, 2017Updated 8 years ago
• koeninger / kafka-exactly-once

  View on GitHub
  ☆243Jun 14, 2018Updated 7 years ago
• jeoffreylim / maelstrom

  View on GitHub
  Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …
  ☆22Feb 6, 2017Updated 9 years ago
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 8 years ago
• hammerlab / spark-tests

  View on GitHub
  Utilities for writing tests that use Apache Spark.
  ☆24Dec 29, 2018Updated 7 years ago
• dibbhatt / kafka-spark-consumer

  View on GitHub
  High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…
  ☆636Feb 26, 2022Updated 3 years ago
• cakesolutions / scala-kafka-client

  View on GitHub
  Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)
  ☆353Aug 10, 2022Updated 3 years ago
• cloudera-labs / envelope

  View on GitHub
  Build configuration-driven ETL pipelines on Apache Spark
  ☆161Oct 4, 2022Updated 3 years ago
• hbase-rdd / hbase-rdd

  View on GitHub
  Spark RDD to read, write and delete from HBase
  ☆273Jan 22, 2021Updated 5 years ago
• jaceklaskowski / spark-workshop

  View on GitHub
  Apache Spark™ and Scala Workshops
  ☆264Jul 29, 2024Updated last year
• makersu / reactive-kafka-scala-example

  View on GitHub
  reactive-kafka examples in scala
  ☆25Sep 7, 2016Updated 9 years ago
• BenFradet / struct-type-encoder

  View on GitHub
  Deriving Spark DataFrame schemas from case classes
  ☆44Jun 24, 2024Updated last year
• ippontech / spark-kafka-source

  View on GitHub
  Kafka stream for Spark with storage of the offsets in ZooKeeper
  ☆60Apr 18, 2017Updated 8 years ago
• holdenk / spark-structured-streaming-ml

  View on GitHub
  Structured Streaming Machine Learning example with Spark 2.0
  ☆94Apr 24, 2017Updated 8 years ago
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆199Apr 15, 2018Updated 7 years ago
• druid-io / tranquility

  View on GitHub
  Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover…
  ☆516Jan 13, 2020Updated 6 years ago
• AbsaOSS / spark-hofs

  View on GitHub
  Scala API for Apache Spark SQL high-order functions
  ☆14Aug 4, 2023Updated 2 years ago
• dk-stationery / stationery-ink

  View on GitHub
  Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark
  ☆12Mar 14, 2016Updated 9 years ago
• Stratio / sparta

  View on GitHub
  Real Time Analytics and Data Pipelines based on Spark Streaming
  ☆531Oct 24, 2019Updated 6 years ago
• palantir / spark-influx-sink

  View on GitHub
  A Spark metrics sink that pushes to InfluxDb
  ☆51Jan 14, 2021Updated 5 years ago
• RedisLabs / spark-redis

  View on GitHub
  A connector for Spark that allows reading and writing to/from Redis cluster
  ☆947Oct 22, 2024Updated last year
• LinMingQiang / sparkstreaming

  View on GitHub
  封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
  ☆183Apr 15, 2021Updated 4 years ago
• cloudera-labs / SparkOnHBase

  View on GitHub
  SparkOnHBase
  ☆278Mar 30, 2021Updated 4 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 9 years ago
• lucasbak / kafka-spark-streaming

  View on GitHub
  Project for reading data from kafka and writing to kafka and HBase with kerberos
  ☆24Dec 8, 2016Updated 9 years ago
• Hydrospheredata / mist

  View on GitHub
  Serverless proxy for Spark cluster
  ☆324Oct 29, 2020Updated 5 years ago
• hbutani / spark-druid-olap

  View on GitHub
  Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…
  ☆281Aug 3, 2018Updated 7 years ago
• snowplow-archive / spark-streaming-example-project

  View on GitHub
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆93Oct 1, 2020Updated 5 years ago
• alvinj / ScalaApacheAccessLogParser

  View on GitHub
  An Apache access log parser written in Scala
  ☆73Feb 27, 2021Updated 4 years ago
• Samsung / spark-cep

  View on GitHub
  Spark CEP is an extension of Spark Streaming to support SQL-based query processing
  ☆57Apr 12, 2017Updated 8 years ago
• LinMingQiang / spark-utils

  View on GitHub
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆36Dec 18, 2019Updated 6 years ago
• qubole / sparklens

  View on GitHub
  Qubole Sparklens tool for performance tuning Apache Spark
  ☆589Jun 26, 2024Updated last year
• LiShuMing / spark-demos

  View on GitHub
  Spark(multi versions) + Streaming/Hive/SQL/UDF Demos
  ☆15May 17, 2018Updated 7 years ago