Alternatives and similar repositories for minipipe

Users that are interested in minipipe are comparing it to the libraries listed below

• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆136Updated 3 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated 2 years ago
• logv / snorkel
  UI for interactive data analysis | https://snorkel.logv.org
  ☆164Updated last year
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 7 years ago
• stripe-archive / timberlake
  Timberlake is a Job Tracker for Hadoop.
  ☆177Updated 5 years ago
• Nextdoor / bender
  Bender - Serverless ETL Framework
  ☆188Updated last year
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆97Updated 5 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• romseygeek / samza-luwak
  Integration of Samza and Luwak
  ☆100Updated 10 years ago
• hammerlab / spree
  Live-updating Spark UI built with Meteor
  ☆189Updated 4 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• brndnmtthws / kafka-on-marathon
  Scripts for running Apache Kafka on Mesosphere's Marathon
  ☆14Updated 9 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 10 years ago
• aseigneurin / spark-ui-proxy
  Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall
  ☆98Updated 5 years ago
• mesosphere-backup / time-series-demo
  A DC/OS time series demo
  ☆62Updated 9 years ago
• Parsely / pyspark-cassandra
  Utilities and examples to asssist in working with PySpark and Cassandra.
  ☆36Updated 10 years ago
• tikal-fuseday / delta-architecture
  Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
  ☆75Updated 2 years ago
• justonedb / kafka-sink-pg-json
  Kafka sink connector for streaming messages to PostgreSQL
  ☆92Updated 4 years ago
• snowplow-archive / schema-guru
  JSONs -> JSON Schema
  ☆152Updated 4 years ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• bythebay / pipeline
  Complete Pipeline Training at Big Data Scala By the Bay
  ☆71Updated 9 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• haifengl / unicorn
  BigTable, Document and Graph Database with Full Text Search
  ☆186Updated 7 years ago
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated last month
• memsql / singlestore-spark-connector
  A connector for SingleStore and Spark
  ☆162Updated last week
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆70Updated 6 months ago