Write your Spark data to Kafka seamlessly
☆173Jul 10, 2024Updated last year
Alternatives and similar repositories for spark-kafka-writer
Users that are interested in spark-kafka-writer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark and Apache Kafka integration example☆122Dec 21, 2017Updated 8 years ago
- Low level integration of Spark and Kafka☆131Mar 15, 2018Updated 8 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Dec 5, 2019Updated 6 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Apr 27, 2017Updated 8 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Feb 7, 2023Updated 3 years ago
- The Internals of Spark Structured Streaming☆423Mar 3, 2026Updated 3 weeks ago
- ☆243Jun 14, 2018Updated 7 years ago
- Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)☆353Aug 10, 2022Updated 3 years ago
- reactive-kafka examples in scala☆25Sep 7, 2016Updated 9 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆40Jun 29, 2017Updated 8 years ago
- Kafka stream for Spark with storage of the offsets in ZooKeeper☆60Apr 18, 2017Updated 8 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆635Feb 26, 2022Updated 4 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆94Apr 24, 2017Updated 8 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Utilities for writing tests that use Apache Spark.☆24Dec 29, 2018Updated 7 years ago
- Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream …☆22Feb 6, 2017Updated 9 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆162Oct 4, 2022Updated 3 years ago
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Dec 18, 2019Updated 6 years ago
- Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover…☆517Jan 13, 2020Updated 6 years ago
- Spark RDD to read, write and delete from HBase☆273Jan 22, 2021Updated 5 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Dec 8, 2016Updated 9 years ago
- ☆24Apr 29, 2016Updated 9 years ago
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆198Apr 15, 2018Updated 7 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆180Apr 15, 2021Updated 4 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆93Oct 1, 2020Updated 5 years ago
- Dashboards to monitor your open source organization's health☆11Dec 19, 2019Updated 6 years ago
- SparkOnHBase☆278Mar 30, 2021Updated 4 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- An Apache access log parser written in Scala☆73Feb 27, 2021Updated 5 years ago
- Deriving Spark DataFrame schemas from case classes☆44Jun 24, 2024Updated last year
- Building blocks and patterns for building data prep transformations and feature engineering in Spark.☆16Mar 16, 2016Updated 10 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Create Kafka-Connect clusters with docker . You put the Kafka, we put the Connect.☆25Mar 27, 2019Updated 7 years ago
- Working example of consuming Avro data from Kafka with Spark Streaming☆12Feb 21, 2016Updated 10 years ago
- A connector for Spark that allows reading and writing to/from Redis cluster☆948Oct 22, 2024Updated last year
- Real Time Analytics and Data Pipelines based on Spark Streaming☆530Oct 24, 2019Updated 6 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- util modules for sbt☆15Apr 24, 2020Updated 5 years ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆281Aug 3, 2018Updated 7 years ago