thanhson1085 / python-kafka-avro
A simple examle for Python Kafka Avro
☆86Updated 6 years ago
Alternatives and similar repositories for python-kafka-avro:
Users that are interested in python-kafka-avro are comparing it to the libraries listed below
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Pure Python wrapper for the Hadoop WebHDFS Rest API☆52Updated 4 years ago
- A client for the Confluent Schema Registry API implemented in Python☆52Updated last year
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆325Updated 4 years ago
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆232Updated 2 years ago
- API and command line interface for HDFS☆272Updated 4 months ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆177Updated 2 years ago
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- Vagrant project to spin up a single virtual machine running current versions of Hadoop, Hive and Spark☆75Updated 6 years ago
- PySpark for Elastic Search☆55Updated 7 years ago
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 6 years ago
- The Internals of Spark Structured Streaming☆417Updated 2 years ago
- An example Apache Beam project.☆111Updated 7 years ago
- ☆75Updated 4 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- A full example of my blog post regarding Sparks stateful streaming (http://asyncified.io/2016/07/31/exploring-stateful-streaming-with-apa…☆34Updated 7 years ago
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆118Updated 8 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- Simple example for reading and writing into Kafka☆55Updated 4 years ago
- ☆240Updated 3 years ago
- Examples of Spark 2.0☆211Updated 3 years ago
- AMQP data source for dstream (Spark Streaming)☆26Updated 2 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆154Updated 11 months ago