thanhson1085 / python-kafka-avro
A simple examle for Python Kafka Avro
☆86Updated 6 years ago
Alternatives and similar repositories for python-kafka-avro:
Users that are interested in python-kafka-avro are comparing it to the libraries listed below
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆233Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- A client for the Confluent Schema Registry API implemented in Python☆53Updated 2 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces☆325Updated 4 years ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆250Updated last month
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆180Updated 2 years ago
- Python DB-API client for Presto☆238Updated last year
- An example Apache Beam project.☆111Updated 7 years ago
- Python client for Hadoop® YARN API☆109Updated 2 years ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- ☆246Updated 5 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Oozie Workflow to Airflow DAGs migration tool☆87Updated last month
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Prometheus Exporter for Airflow☆160Updated 10 months ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Airflow declarative DAGs via YAML☆132Updated last year
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated 6 months ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- ☆209Updated 8 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆200Updated last week
- A Python implementation of Apache Kafka Streams☆311Updated 6 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆242Updated 10 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago