Alternatives and similar repositories for kafkian

Users that are interested in kafkian are comparing it to the libraries listed below

• steveloughran / zero-rename-committer
  Paper: A Zero-rename committer for object stores
  ☆20Updated 3 years ago
• anemos-io / protobeam
  ☆22Updated 6 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆111Updated 5 years ago
• lensesio / lenses-go
  Lenses.io CLI (command-line interface)
  ☆35Updated 5 months ago
• lensesio / datagen
  A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system
  ☆14Updated 4 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• lensesio / lenses-python
  Python library for Lenses.io / Kafka platform engineers
  ☆19Updated last year
• lensesio / kafka-connect-common
  Common components used across the datamountaineer kafka connect connectors
  ☆21Updated 4 years ago
• tobilg / docker-livy
  A Docker image for Livy, the REST Spark Server
  ☆15Updated 8 years ago
• lensesio / avro-sql
  Use SQL to transform your avro schema/records
  ☆28Updated 7 years ago
• jgrier / FilteringExample
  Flink stream filtering examples
  ☆19Updated 8 years ago
• lensesio / lenses-jdbc
  Lenses.io JDBC driver for Apache Kafka
  ☆21Updated 4 years ago
• rmoff / vsc-ksql
  KSQL Syntax Highlighting for VSCode
  ☆17Updated 2 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• tubular / confluent-spark-avro
  Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.
  ☆19Updated 7 years ago
• HiveRunner / mutant-swarm
  Mutation testing framework and code coverage for Hive SQL
  ☆24Updated 4 years ago
• jcustenborder / connect-utils
  Utility project for working with Kafka Connect.
  ☆34Updated 9 months ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 4 years ago
• ExpediaGroup / jasvorno
  A library for strong, schema based conversion between 'natural' JSON documents and Avro
  ☆18Updated last year
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• snowplow / snowplow-scala-analytics-sdk
  Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.
  ☆21Updated 6 months ago
• farmdawgnation / kafka-hawk
  An application that records stats about consumer group offset commits and reports them as prometheus metrics
  ☆14Updated 6 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• verisign / python-confluent-schemaregistry
  A client for the Confluent Schema Registry API implemented in Python
  ☆53Updated 2 years ago
• BigDataBoutique / presto-cloud-deploy
  Deploy Presto on the cloud easily, using Terraform and Packer
  ☆45Updated 2 years ago
• rayokota / stream-processing-kickstarter
  A comparison of stream-processing frameworks with Kafka integration
  ☆10Updated 6 years ago