Alternatives and similar repositories for spark-compaction:

Users that are interested in spark-compaction are comparing it to the libraries listed below

• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• criteo / babar
  Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.
  ☆126Updated 6 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated last month
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• egen / spark-sftp
  Spark connector for SFTP
  ☆100Updated 2 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• AndreSchumacher / avro-parquet-spark-example
  An example of using Avro and Parquet in Spark SQL
  ☆60Updated 9 years ago
• hammerlab / yarn-logs-helpers
  Scripts for parsing / making sense of yarn logs
  ☆52Updated 8 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 7 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 11 months ago
• rdblue / s3committer
  Hadoop output committers for S3
  ☆108Updated 4 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• tresata / spark-kafka
  Low level integration of Spark and Kafka
  ☆130Updated 7 years ago
• metamx / druid-spark-batch
  Druid indexing plugin for using Spark in batch jobs
  ☆101Updated 3 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago
• edwardcapriolo / filecrush
  Remedy small files by combining them into larger ones.
  ☆193Updated 2 years ago
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆146Updated 4 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 3 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• tmalaska / SparkOnKudu
  Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.
  ☆50Updated 8 years ago