googlegenomics / dataflow-java
Google Cloud Dataflow pipelines such as Identity-By-State as well as useful utility classes.
☆37Updated last year
Alternatives and similar repositories for dataflow-java:
Users that are interested in dataflow-java are comparing it to the libraries listed below
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- Cascading on Apache Flink®☆54Updated last year
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- Dockerflow is a workflow runner that uses Dataflow to run a series of tasks in Docker with the Pipelines API☆97Updated 7 years ago
- Apache Spark jobs such as Principal Coordinate Analysis.☆74Updated 8 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- Muppet☆126Updated 3 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Apache Beam Site☆29Updated 3 weeks ago
- CDAP Applications☆43Updated 7 years ago
- A template-based cluster provisioning system☆61Updated 2 years ago
- Modeling Lifecycle with ACME Occupancy Detection and Cloudera☆14Updated 7 years ago
- Accompanying repository for FIS/SunGard's whitepaper on using the Dataflow SDK to transform options market data☆22Updated 8 years ago
- Efficient, distributed downloads of large files from S3 to HDFS using Spark.☆17Updated 7 years ago
- Scriptable scheduler for periodical Hadoop workflows☆22Updated 7 years ago
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- Reproducing Distributed Systems and Experiments on Cloud☆39Updated last year
- Experiments with the GDELT dataset and Cassandra schemas.☆25Updated 9 years ago
- Tutorials for Cascading, Lingual, Pattern and other projects☆18Updated 8 years ago
- Cloudbreak Deployer Tool☆34Updated last year
- CDAP Cube Dataset Guide☆12Updated 7 years ago
- ☆51Updated 9 years ago
- ☆9Updated 9 years ago
- Apache Spark under Docker☆9Updated 8 years ago
- Use SQL to transform your avro schema/records☆28Updated 7 years ago
- A Cascading Workflow Visualizer☆83Updated last year
- A basic example of how to read and write streaming data using Apache Spark and Kafka on HDInsight☆13Updated 2 years ago
- ☆17Updated 9 years ago
- A utility for generating Oozie workflows from a YAML definition☆48Updated 6 years ago
- Miscellaneous functionality for manipulating Apache Spark RDDs.☆22Updated 6 years ago