saabeilin / kafkianLinks
An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka
☆27Updated 8 months ago
Alternatives and similar repositories for kafkian
Users that are interested in kafkian are comparing it to the libraries listed below
Sorting:
- JSON schema parser for Apache Spark☆82Updated 3 years ago
- JSON to Avro conversion tool designed to make migration to Avro easier.☆288Updated 6 months ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 4 months ago
- A client for the Confluent Schema Registry API implemented in Python☆21Updated 7 years ago
- Apache (Py)Spark type annotations (stub files).☆118Updated 3 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Kafka Connect Tooling☆117Updated 4 years ago
- A python wrapper for the KSQL REST API.☆158Updated 2 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- KSQL Syntax Highlighting for VSCode☆17Updated 3 years ago
- No longer maintained and soon to be deleted☆77Updated 6 years ago
- Bash completion for Kafka command line utilities.☆36Updated 6 months ago
- An example of streaming microservices with Apache Kafka and Data Flow Topology integration with Lenses Ⓡ DataOps Platform. You can see it…☆15Updated 2 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 7 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆114Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 7 months ago
- ☆81Updated 2 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆37Updated 5 years ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 5 years ago
- A client for the Confluent Schema Registry API implemented in Python☆53Updated 2 years ago
- Python Rest Client to interact against Schema Registry confluent server☆179Updated last month
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆76Updated last year
- Schema Registry integration for Apache Spark☆40Updated 3 years ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆160Updated 3 weeks ago
- Example of different security configurations for Apache Kafka and the Confluent Platform☆179Updated last year
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- Avro SerDe for Apache Spark structured APIs.☆239Updated 7 months ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 6 years ago
- Protobuf converter plugin for Kafka Connect☆94Updated 2 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Updated 8 years ago