Cargill / pipewrench
Data pipeline automation tool
☆26Updated last year
Alternatives and similar repositories for pipewrench:
Users that are interested in pipewrench are comparing it to the libraries listed below
- Ambari View for the Ambari Store☆15Updated 9 years ago
- ☆10Updated 10 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Flink Examples☆39Updated 8 years ago
- Example projects for using Spark and Cassandra With DSE Analytics☆58Updated last year
- Hadoop Data Pipeline using Falcon☆15Updated 8 years ago
- Spark cloud integration: tests, cloud committers and more☆19Updated last month
- Workshop for Hadoop Operations Best Practices☆10Updated 10 years ago
- A set of utilities to help with management of Streamsets pipelines.☆13Updated 6 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- Ansible playbook for automated HDP 2.x deployment install with Kerberos☆19Updated 8 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- Cascading on Apache Flink®☆54Updated last year
- Sample custom Nifi processor to process tcpdump☆18Updated 9 years ago
- Ambari and Cloudera Manager in Docker☆22Updated 6 years ago
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆28Updated 8 years ago
- functionstest☆33Updated 8 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 8 years ago
- Complete Pipeline Training at Big Data Scala By the Bay☆71Updated 9 years ago
- Random implementation notes☆33Updated 11 years ago
- Vagrant files creating multi-node virtual Hadoop clusters with or without security.☆67Updated 4 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆95Updated 5 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server☆49Updated last year
- Ambari Service definition for deploying R & RHadoop libraries☆18Updated 9 years ago
- A spark sbt blueprint to build your own spark apps off of (for cloud native runtime, see the kube/spark examples)☆56Updated 5 years ago