Cargill / pipewrench
Data pipeline automation tool
☆25Updated last year
Alternatives and similar repositories for pipewrench:
Users that are interested in pipewrench are comparing it to the libraries listed below
- A set of utilities to help with management of Streamsets pipelines.☆13Updated 6 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- Flink Examples☆39Updated 8 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Cascading on Apache Flink®☆54Updated 11 months ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- HDF masterclass materials☆28Updated 8 years ago
- Hadoop Data Pipeline using Falcon☆15Updated 8 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- functionstest☆33Updated 8 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 5 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 8 years ago
- phData Pulse application log aggregation and monitoring☆13Updated 4 years ago
- Random implementation notes☆33Updated 11 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 4 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Updated 10 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated 10 months ago
- An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase☆14Updated 8 years ago
- ☆33Updated 9 years ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 10 months ago
- Example projects for using Spark and Cassandra With DSE Analytics☆58Updated last year
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Updated 8 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆49Updated last year
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- ☆26Updated 5 years ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago