Alternatives and similar repositories for data_pipeline:

Users that are interested in data_pipeline are comparing it to the libraries listed below

• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 3 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 2 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• metamx / druid
  Real²time Exploratory Analytics on Large Datasets
  ☆122Updated 4 years ago
• airbnb / reair
  ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.
  ☆280Updated 5 years ago
• implydata / plyql
  MySQL-like queries for Druid built on top of Plywood
  ☆147Updated 5 years ago
• Yelp / mysql_streamer
  MySQLStreamer is a database change data capture and publish system.
  ☆410Updated 2 years ago
• mtth / azkaban
  Lightweight Azkaban client
  ☆77Updated 4 years ago
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆52Updated 9 years ago
• treasure-data / prestogres
  PostgreSQL protocol gateway for Presto distributed SQL query engine
  ☆291Updated last year
• wushujames / kafka-mysql-connector
  A plugin to the Kafka Connect framework that replicates data from MySQL to Kafka
  ☆97Updated 8 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆98Updated 7 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆103Updated 8 years ago
• hbutani / spark-druid-olap
  Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…
  ☆283Updated 6 years ago
• petrabarus / HiveUDFs
  My Personal Collection of Hive UDFs
  ☆34Updated 12 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• BradRuderman / pyhs2
  ☆209Updated 8 years ago
• justonedb / kafka-sink-pg-json
  Kafka sink connector for streaming messages to PostgreSQL
  ☆90Updated 4 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 4 years ago
• yahoo / hive-funnel-udf
  Hive UDFs for funnel analysis
  ☆84Updated last year
• Aloisius / hadoop-s3a
  An AWS SDK-backed FileSystem driver for Hadoop
  ☆64Updated 4 years ago
• LinkedInAttic / Cubert
  Fast and efficient batch computation engine for complex analysis and reporting of massive datasets on Hadoop
  ☆244Updated 9 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆133Updated 4 years ago
• miguno / avro-cli-examples
  Examples on how to use the command line tools in Avro Tools to read and write Avro files
  ☆153Updated 8 months ago
• cloudera / hs2client
  C++ native client for Impala and Hive, with Python / pandas bindings
  ☆72Updated 6 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 9 years ago