saabeilin / kafkianLinks
An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka
☆27Updated last month
Alternatives and similar repositories for kafkian
Users that are interested in kafkian are comparing it to the libraries listed below
Sorting:
- ☆22Updated 6 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system☆14Updated 4 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 4 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Tool for exploring data on an Apache Kafka cluster☆42Updated 4 years ago
- Spark job for compacting avro files together☆12Updated 7 years ago
- Lenses.io CLI (command-line interface)☆37Updated 7 months ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Updated 7 months ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- KSQL Syntax Highlighting for VSCode☆17Updated 2 years ago
- Docker image for Apache Hive running on Tez☆7Updated 10 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆112Updated 5 years ago
- A comparison of stream-processing frameworks with Kafka integration☆10Updated 6 years ago
- Real-time anomaly detection using Kafka, KSQL User Defined Function and a pre-trained model☆30Updated last year
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 6 years ago
- Embedded Kafka for testing and quick prototyping.☆14Updated 9 years ago
- A client for the Confluent Schema Registry API implemented in Python☆53Updated 2 years ago
- Test suite for Kafka Connect connectors based on Landoop's Coyote and docker.☆31Updated 5 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Updated 7 years ago
- A Docker image for Livy, the REST Spark Server☆15Updated 9 years ago
- Trivially Up a cluster of applications (such as a Kafka cluster!)☆49Updated last year
- Kafka Streams + Memcached (e.g. AWS ElasticCache) for low-latency in-memory lookups☆13Updated 5 years ago
- A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).☆17Updated last year
- A small library of hive UDFS using Macros to process and manipulate complex types☆15Updated 4 years ago
- Python library for Lenses.io / Kafka platform engineers☆19Updated last year
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 8 years ago
- In-deprecation. For Lenses please check lensesio/lenses-helm-charts. Soon Stream Reactor will also get its own Helm repository.☆70Updated 4 years ago