Alternatives and similar repositories for data_pipeline:

Users that are interested in data_pipeline are comparing it to the libraries listed below

• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆52Updated 9 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• implydata / plyql
  MySQL-like queries for Druid built on top of Plywood
  ☆147Updated 5 years ago
• wushujames / kafka-mysql-connector
  A plugin to the Kafka Connect framework that replicates data from MySQL to Kafka
  ☆97Updated 8 years ago
• airbnb / reair
  ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.
  ☆282Updated 6 years ago
• sentric / hannibal
  Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.
  ☆172Updated 7 years ago
• Yelp / mysql_streamer
  MySQLStreamer is a database change data capture and publish system.
  ☆410Updated 2 years ago
• metamx / druid
  Real²time Exploratory Analytics on Large Datasets
  ☆122Updated 5 years ago
• yahoo / hive-funnel-udf
  Hive UDFs for funnel analysis
  ☆83Updated 2 years ago
• mtth / azkaban
  Lightweight Azkaban client
  ☆77Updated 5 years ago
• treasure-data / prestogres
  PostgreSQL protocol gateway for Presto distributed SQL query engine
  ☆292Updated last year
• BradRuderman / pyhs2
  ☆209Updated 8 years ago
• hbutani / spark-druid-olap
  Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…
  ☆282Updated 6 years ago
• livingsocial / HiveSwarm
  Helpful user defined fuctions / table generating functions for Hive
  ☆101Updated 8 years ago
• LinkedInAttic / Cubert
  Fast and efficient batch computation engine for complex analysis and reporting of massive datasets on Hadoop
  ☆243Updated 9 years ago
• blackberry / KaBoom
  A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths
  ☆42Updated 8 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆98Updated 7 years ago
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 5 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• harelba / tail2kafka
  Tail a log file and send log lines automatically to a kafka topic
  ☆57Updated 12 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• verisign / python-confluent-schemaregistry
  A client for the Confluent Schema Registry API implemented in Python
  ☆53Updated 2 years ago
• metamx / druid-spark-batch
  Druid indexing plugin for using Spark in batch jobs
  ☆101Updated 3 years ago
• AirSage / Petrel
  Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python
  ☆246Updated 2 years ago
• otoolep / stormkafkamon
  Dumps state of Storm Kafka consumers
  ☆96Updated 7 years ago
• adobe-research / spindle
  Next-generation web analytics processing with Scala, Spark, and Parquet.
  ☆331Updated 10 years ago