Alternatives and similar repositories for dataset-logger

Users that are interested in dataset-logger are comparing it to the libraries listed below

• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• wjur / avsc2avdl
  Avro Schema to Avro IDL converter
  ☆18Updated 8 months ago
• linkedin / avro-util
  Collection of utilities to allow writing java code that operates across a wide range of avro versions.
  ☆84Updated last week
• streamthoughts / azkarra-streams
  🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Ap…
  ☆183Updated 2 weeks ago
• tosun-si / asgarde
  Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.
  ☆75Updated last year
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆115Updated this week
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated 11 months ago
• bakdata / fluent-kafka-streams-tests
  Fluent Kafka Streams Test with Java
  ☆90Updated 2 weeks ago
• godatadriven / scala-spark-application
  ☆32Updated 7 years ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated 3 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• GoogleCloudDataproc / flink-bigquery-connector
  BigQuery connector for Apache Flink
  ☆33Updated 2 months ago
• cloudera / kafka-examples
  Kafka Examples repository.
  ☆44Updated 6 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last month
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 3 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆184Updated 2 years ago
• AzimoLabs / kafka-to-avro-writer
  Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud s…
  ☆25Updated 4 years ago
• anemos-io / protobeam
  ☆22Updated 6 years ago
• RTBHOUSE / avro-fastserde
  Fast Apache Avro serialization/deserialization library
  ☆45Updated 4 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago
• wushujames / kafka-utilities
  ☆26Updated 5 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 4 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago
• allegro / json-avro-converter
  JSON to Avro conversion tool designed to make migration to Avro easier.
  ☆284Updated 2 months ago
• hortonworks / registry
  Schema Registry
  ☆17Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• agile-lab-dev / darwin
  Avro Schema Evolution made easy
  ☆36Updated last year
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 10 months ago
• allegro / camus-compressor
  Camus Compressor merges files created by Camus and saves them in a compressed format.
  ☆13Updated 2 years ago