Alternatives and similar repositories for dataset-logger

Users that are interested in dataset-logger are comparing it to the libraries listed below

• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• wjur / avsc2avdl
  Avro Schema to Avro IDL converter
  ☆18Updated 3 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 weeks ago
• RTBHOUSE / avro-fastserde
  Fast Apache Avro serialization/deserialization library
  ☆43Updated 4 years ago
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆116Updated this week
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 6 months ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• GoogleCloudDataproc / flink-bigquery-connector
  BigQuery connector for Apache Flink
  ☆31Updated 2 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 7 months ago
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last week
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated last year
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 3 months ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 7 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago
• rdblue / s3committer
  Hadoop output committers for S3
  ☆109Updated 4 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• tupol / spark-utils
  Basic framework utilities to quickly start writing production ready Apache Spark applications
  ☆36Updated 5 months ago
• liquidm / druid-dumbo
  ☆21Updated 2 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆77Updated last month
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago