Alternatives and similar repositories for data_pipeline:

Users that are interested in data_pipeline are comparing it to the libraries listed below

• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆52Updated 9 years ago
• mtth / azkaban
  Lightweight Azkaban client
  ☆77Updated 5 years ago
• sentric / hannibal
  Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.
  ☆172Updated 7 years ago
• Yelp / mysql_streamer
  MySQLStreamer is a database change data capture and publish system.
  ☆410Updated 2 years ago
• wushujames / kafka-mysql-connector
  A plugin to the Kafka Connect framework that replicates data from MySQL to Kafka
  ☆97Updated 8 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• metamx / druid
  Real²time Exploratory Analytics on Large Datasets
  ☆122Updated 5 years ago
• airbnb / reair
  ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.
  ☆283Updated 6 years ago
• yahoo / hive-funnel-udf
  Hive UDFs for funnel analysis
  ☆83Updated 2 years ago
• hbutani / spark-druid-olap
  Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…
  ☆283Updated 6 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• otoolep / stormkafkamon
  Dumps state of Storm Kafka consumers
  ☆96Updated 7 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• treasure-data / prestogres
  PostgreSQL protocol gateway for Presto distributed SQL query engine
  ☆292Updated last year
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 5 years ago
• implydata / plyql
  MySQL-like queries for Druid built on top of Plywood
  ☆147Updated 5 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆98Updated 7 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• petrabarus / HiveUDFs
  My Personal Collection of Hive UDFs
  ☆34Updated 12 years ago
• hammerlab / grafana-spark-dashboards
  Scripts for generating Grafana dashboards for monitoring Spark jobs
  ☆242Updated 9 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago
• harelba / tail2kafka
  Tail a log file and send log lines automatically to a kafka topic
  ☆57Updated 12 years ago
• metamx / druid-spark-batch
  Druid indexing plugin for using Spark in batch jobs
  ☆101Updated 3 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• cloudera / hs2client
  C++ native client for Impala and Hive, with Python / pandas bindings
  ☆72Updated 6 years ago
• srikalyc / Sql4D
  Sql interface to druid.
  ☆77Updated 9 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago