Alternatives and similar repositories for minipipe

Users that are interested in minipipe are comparing it to the libraries listed below

• logv / snorkel
  UI for interactive data analysis | https://snorkel.logv.org
  ☆167Updated last year
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆134Updated 3 years ago
• tikal-fuseday / delta-architecture
  Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
  ☆76Updated 2 years ago
• wix-incubator / kafka-connect-s3
  A Kafka-Connect Sink for S3 with no Hadoop dependencies.
  ☆57Updated 2 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 5 years ago
• Nextdoor / bender
  Bender - Serverless ETL Framework
  ☆188Updated 2 years ago
• stripe-archive / timberlake
  Timberlake is a Job Tracker for Hadoop.
  ☆177Updated 5 years ago
• bomboradata / pubsub-to-bigquery
  A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub
  ☆67Updated 7 years ago
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• qubole / afctl
  afctl helps to manage and deploy Apache Airflow projects faster and smoother.
  ☆130Updated 3 years ago
• haifengl / unicorn
  BigTable, Document and Graph Database with Full Text Search
  ☆186Updated 7 years ago
• snowplow-archive / schema-guru
  JSONs -> JSON Schema
  ☆153Updated 5 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• romseygeek / samza-luwak
  Integration of Samza and Luwak
  ☆100Updated 11 years ago
• snowplow / iglu
  Iglu is a machine-readable, open-source schema repository for JSON Schema from the team at Snowplow
  ☆214Updated 3 weeks ago
• gaul / are-we-consistent-yet
  Compare eventual consistency of object stores
  ☆177Updated last year
• snowplow / snowplow-s3-loader
  Mirrors a Kinesis stream to Amazon S3 using the KCL
  ☆42Updated 6 months ago
• jpzk / twitterstream
  Twitter Streaming API Example with Kafka Streams in Scala
  ☆49Updated 9 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 6 years ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• snowplow-archive / google-cloud-dataflow-example-project
  Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow
  ☆30Updated 8 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆114Updated 5 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 8 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated 2 years ago
• snowplow-archive / sauna
  A decisioning and response platform
  ☆70Updated 4 years ago
• Banno / druid-docker
  Docker containers for Druid nodes
  ☆27Updated 9 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆88Updated 4 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆96Updated 6 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 3 years ago