Alternatives and similar repositories for minipipe:

Users that are interested in minipipe are comparing it to the libraries listed below

• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 7 months ago
• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated 2 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 3 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• brndnmtthws / kafka-on-marathon
  Scripts for running Apache Kafka on Mesosphere's Marathon
  ☆14Updated 9 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 6 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• memsql / streamliner-examples
  Example code for building your own MemSQL Streamliner Pipelines
  ☆23Updated 8 years ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• darkjh / scalaflow
  Fluent Scala DSL for Google's Cloud Dataflow SDK
  ☆56Updated 9 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆111Updated 5 years ago
• epahomov / docker-zeppelin
  Docker image for apache zeppelin
  ☆38Updated 8 years ago
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 8 years ago
• collectivemedia / spark-hyperloglog
  Interactive Audience Analytics with Spark and HyperLogLog
  ☆55Updated 9 years ago
• lynnlangit / Spark-Scala-EKS
  Spark Scala docker container sample for AWS testing - EKS & S3
  ☆24Updated 6 years ago
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 8 years ago
• snowplow-archive / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 3 years ago
• snowplow-archive / sauna
  A decisioning and response platform
  ☆70Updated 3 years ago
• zutherb / terraform-dcos
  Terraform module to bootstrap a DCOS cluster
  ☆57Updated 7 years ago
• lightbend / mesos-spark-integration-tests
  Mesos Integration Tests on Docker/Ec2
  ☆15Updated last year
• saurfang / sparksql-protobuf
  Read SparkSQL parquet file as RDD[Protobuf]
  ☆93Updated 6 years ago
• stripe-archive / timberlake
  Timberlake is a Job Tracker for Hadoop.
  ☆177Updated 5 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• broxtronix / spark-gce
  A tool for running Spark on Google Compute Engine
  ☆16Updated 8 years ago
• lresende / docker-yarn-cluster
  Apache Yarn cluster docker image
  ☆35Updated 7 years ago