Alternatives and similar repositories for minipipe

Users that are interested in minipipe are comparing it to the libraries listed below

• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated 2 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 3 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆111Updated 5 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• bkirwi / coast
  Experiments in Streaming
  ☆60Updated 8 years ago
• adplabs / unicorn
  ☆39Updated 8 years ago
• jpzk / twitterstream
  Twitter Streaming API Example with Kafka Streams in Scala
  ☆49Updated 8 years ago
• snowplow-archive / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 3 years ago
• memsql / streamliner-examples
  Example code for building your own MemSQL Streamliner Pipelines
  ☆23Updated 8 years ago
• lensesio / avro-sql
  Use SQL to transform your avro schema/records
  ☆28Updated 7 years ago
• darkjh / scalaflow
  Fluent Scala DSL for Google's Cloud Dataflow SDK
  ☆56Updated 9 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• theduderog / hello-samza-confluent
  Simple Samza Job Using Confluent Platform
  ☆14Updated 9 years ago
• tuplejump / kafka-connect-cassandra
  Kafka Connect Cassandra Connector. This project includes source/sink connectors for Cassandra to/from Kafka.
  ☆78Updated 8 years ago
• spotify / hype
  Runs JVM closures in Docker containers on Kubernetes
  ☆36Updated 7 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• epahomov / docker-zeppelin
  Docker image for apache zeppelin
  ☆38Updated 8 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 8 months ago
• IgorBerman / spark-gotchas
  Few things we've met during our etl project based on spark
  ☆24Updated 7 years ago
• ImpalaToGo / ImpalaToGo
  Fork of Cloudera Impala separated from Hadoop
  ☆42Updated 8 years ago
• qubole / kinesis-storage-handler
  Hive Storage Handler for Kinesis.
  ☆11Updated 9 years ago
• collectivemedia / spark-hyperloglog
  Interactive Audience Analytics with Spark and HyperLogLog
  ☆55Updated 9 years ago
• GoogleCloudPlatform / spark-examples
  Spark pipelines that correspond to a series of Dataflow examples.
  ☆27Updated 6 years ago