Alternatives and similar repositories for zero-rename-committer:

Users that are interested in zero-rename-committer are comparing it to the libraries listed below

• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• trinodb / tempto
  A testing framework for Trino
  ☆26Updated last month
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆70Updated 2 weeks ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• potix2 / spark-google-spreadsheets
  Google Spreadsheets datasource for SparkSQL and DataFrames
  ☆57Updated last year
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆28Updated 4 years ago
• anemos-io / protobeam
  ☆22Updated 6 years ago
• spotify / scio.g8
  A Giter8 template for scio
  ☆31Updated 3 months ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• lightbend / flink-k8s-operator
  An example of building kubernetes operator (Flink) using Abstract operator's framework
  ☆26Updated 5 years ago
• GoogleCloudPlatform / spark-on-k8s-gcp-examples
  Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
  ☆37Updated 7 years ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last year
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆66Updated 2 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• isarn / isarn-sketches
  Sketching data structures for scala, including t-digest
  ☆15Updated 3 years ago
• snowflakedb / snowflake-hive-metastore-connector
  ☆14Updated 2 months ago
• imduffy15 / spark-avro-compactor
  Spark job for compacting avro files together
  ☆12Updated 7 years ago
• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆98Updated 5 years ago
• qubole / s3-sqs-connector
  A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
  ☆17Updated last year