Alternatives and similar repositories for dataset-logger:

Users that are interested in dataset-logger are comparing it to the libraries listed below

• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆29Updated this week
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated last year
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆114Updated this week
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 8 months ago
• agile-lab-dev / darwin
  Avro Schema Evolution made easy
  ☆34Updated 11 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• wjur / avsc2avdl
  Avro Schema to Avro IDL converter
  ☆16Updated 3 years ago
• RTBHOUSE / avro-fastserde
  Fast Apache Avro serialization/deserialization library
  ☆43Updated 4 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆102Updated this week
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 2 months ago
• bakdata / fluent-kafka-streams-tests
  Fluent Kafka Streams Test with Java
  ☆88Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆71Updated this week
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆86Updated 10 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆104Updated 3 months ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• sjwiesman / flink-scala-3
  ☆36Updated 2 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• snowflakedb / snowflake-kafka-connector
  Snowflake Kafka Connector (Sink Connector)
  ☆144Updated this week
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• AzimoLabs / kafka-to-avro-writer
  Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud s…
  ☆25Updated 3 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated last year
• ExpediaGroup / avro-compatibility
  A user friendly API for checking for and reporting on Avro schema incompatibilities.
  ☆59Updated 10 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 3 months ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆101Updated 7 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year