Alternatives and similar repositories for pipewrench:

Users that are interested in pipewrench are comparing it to the libraries listed below

• phdata / sdc-api-tool
  A set of utilities to help with management of Streamsets pipelines.
  ☆13Updated 6 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• massie / spark-parquet-example
  Example project to show how to use Spark to read and write Avro/Parquet files
  ☆50Updated 11 years ago
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆19Updated 2 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 7 months ago
• ExpediaGroup / jasvorno
  A library for strong, schema based conversion between 'natural' JSON documents and Avro
  ☆18Updated last year
• memsql / streamliner-starter
  Starter project for building MemSQL Streamliner Pipelines
  ☆32Updated 7 years ago
• phdata / pulse
  phData Pulse application log aggregation and monitoring
  ☆13Updated 5 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆50Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• hortonworks / hive-json
  A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.
  ☆42Updated last year
• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• gbraccialli / HdfsUtils
  ☆15Updated 7 years ago
• ExpediaGroup / beeju
  JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs
  ☆26Updated 3 months ago
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• streaming-analytics / Styx
  Streaming Analytics platform, built with Apache Flink and Kafka
  ☆35Updated last year
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 2 months ago
• seanorama / workshop-hadoop-ops
  Workshop for Hadoop Operations Best Practices
  ☆10Updated 10 years ago
• abajwa-hw / nifi-network-processor
  Sample custom Nifi processor to process tcpdump
  ☆18Updated 9 years ago
• laserson / avro2parquet
  Hadoop MapReduce tool to convert Avro data files to Parquet format.
  ☆34Updated 11 years ago
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆95Updated 5 years ago