Cargill / pipewrench
Data pipeline automation tool
☆25Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for pipewrench
- Spark structured streaming with Kafka data source and writing to Cassandra☆64Updated 4 years ago
- phData Pulse application log aggregation and monitoring☆13Updated 4 years ago
- Flink Examples☆39Updated 8 years ago
- Schema Registry integration for Apache Spark☆39Updated 2 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 3 years ago
- Apache Spark ETL Utilities☆40Updated 3 weeks ago
- functionstest☆33Updated 8 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Updated 10 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 8 months ago
- Sample custom Nifi processor to process tcpdump☆18Updated 9 years ago
- ☆54Updated 10 years ago
- ☆33Updated 8 years ago
- JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs☆25Updated last month
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Cascading on Apache Flink®☆54Updated 9 months ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 7 years ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 9 years ago
- An opinionated auto-deployer for the Hortonworks Platform☆34Updated 3 years ago
- ☆26Updated 4 years ago
- NRT Sessionization with Spark Streaming landing on HDFS and putting live stats in HBase☆51Updated 10 years ago
- A simple Twitter-Streaming Application for Apache Flink☆21Updated 8 years ago
- A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.☆42Updated 11 months ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 3 years ago