Alternatives and similar repositories for minipipe:

Users that are interested in minipipe are comparing it to the libraries listed below

• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 2 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated last year
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• memsql / streamliner-examples
  Example code for building your own MemSQL Streamliner Pipelines
  ☆23Updated 7 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆46Updated last year
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆154Updated 11 months ago
• darkjh / scalaflow
  Fluent Scala DSL for Google's Cloud Dataflow SDK
  ☆56Updated 9 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆111Updated 4 years ago
• jpzk / twitterstream
  Twitter Streaming API Example with Kafka Streams in Scala
  ☆49Updated 8 years ago
• romseygeek / samza-luwak
  Integration of Samza and Luwak
  ☆99Updated 10 years ago
• bullet-db / bullet-core
  Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…
  ☆41Updated 2 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 5 months ago
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 7 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 8 years ago
• tikal-fuseday / delta-architecture
  Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
  ☆74Updated 2 years ago
• TIBCOSoftware / snappy-cloud-tools
  SnappyData Cloud Utilities
  ☆13Updated 4 years ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 5 years ago
• mesosphere-backup / time-series-demo
  A DC/OS time series demo
  ☆62Updated 9 years ago
• mustafaakin / big-data-docker
  Better, container friendly big-data images for Docker
  ☆39Updated 8 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆96Updated 5 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 6 years ago
• lensesio / avro-sql
  Use SQL to transform your avro schema/records
  ☆28Updated 7 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• justonedb / kafka-sink-pg-json
  Kafka sink connector for streaming messages to PostgreSQL
  ☆90Updated 4 years ago
• vpon / protobuf-to-avro
  dynamically parse protobuf message then convert to avro
  ☆25Updated 9 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago