Alternatives and similar repositories for dataset-logger

Users that are interested in dataset-logger are comparing it to the libraries listed below

• wjur / avsc2avdl
  Avro Schema to Avro IDL converter
  ☆18Updated 11 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆114Updated this week
• RTBHOUSE / avro-fastserde
  Fast Apache Avro serialization/deserialization library
  ☆45Updated 5 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 3 years ago
• bakdata / fluent-kafka-streams-tests
  Fluent Kafka Streams Test with Java
  ☆91Updated last week
• snowflakedb / snowflake-kafka-connector
  Snowflake Kafka Connector (Sink Connector)
  ☆162Updated this week
• streamthoughts / azkarra-streams
  🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Ap…
  ☆186Updated 4 months ago
• godatadriven / scala-spark-application
  ☆32Updated 7 years ago
• anemos-io / protobeam
  ☆22Updated 6 years ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆239Updated 7 months ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 3 weeks ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆91Updated last year
• agile-lab-dev / darwin
  Avro Schema Evolution made easy
  ☆36Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• getindata / datapill
  Big Data Newsletter
  ☆23Updated last year
• hortonworks / registry
  Schema Registry
  ☆17Updated last year
• tosun-si / asgarde
  Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.
  ☆87Updated 3 weeks ago
• ExpediaGroup / avro-compatibility
  A user friendly API for checking for and reporting on Avro schema incompatibilities.
  ☆59Updated last year
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated 2 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• wushujames / kafka-utilities
  ☆26Updated 6 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆184Updated 2 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago
• Aiven-Open / transforms-for-apache-kafka-connect
  Aiven's collection of Single Message Transformations (SMTs) for Apache Kafka Connect
  ☆87Updated 3 months ago
• mmolimar / ksql-jdbc-driver
  JDBC driver for Apache Kafka
  ☆86Updated 3 years ago
• linkedin / avro-util
  Collection of utilities to allow writing java code that operates across a wide range of avro versions.
  ☆86Updated last month