Alternatives and similar repositories for data_pipeline

Users that are interested in data_pipeline are comparing it to the libraries listed below

• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆27Updated 3 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• treasure-data / prestogres
  PostgreSQL protocol gateway for Presto distributed SQL query engine
  ☆292Updated 2 years ago
• Yelp / mysql_streamer
  MySQLStreamer is a database change data capture and publish system.
  ☆411Updated 3 years ago
• implydata / plyql
  MySQL-like queries for Druid built on top of Plywood
  ☆147Updated 5 years ago
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆53Updated 9 years ago
• wushujames / kafka-mysql-connector
  A plugin to the Kafka Connect framework that replicates data from MySQL to Kafka
  ☆96Updated 9 years ago
• metamx / druid
  Real²time Exploratory Analytics on Large Datasets
  ☆122Updated 5 years ago
• airbnb / reair
  ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.
  ☆279Updated 6 years ago
• memsql / singlestore-spark-connector
  A connector for SingleStore and Spark
  ☆162Updated last week
• harelba / tail2kafka
  Tail a log file and send log lines automatically to a kafka topic
  ☆57Updated 13 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 10 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆100Updated 8 years ago
• xstevens / pg_kafka
  INACTIVE: A PostgreSQL extension to produce messages to Apache Kafka.
  ☆112Updated 10 years ago
• AirSage / Petrel
  Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python
  ☆246Updated 2 years ago
• LinkedInAttic / Cubert
  Fast and efficient batch computation engine for complex analysis and reporting of massive datasets on Hadoop
  ☆244Updated 9 years ago
• hbutani / spark-druid-olap
  Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…
  ☆282Updated 7 years ago
• prestodb / presto-admin
  A tool to install, configure and manage Presto installations
  ☆170Updated 2 years ago
• yahoo / hive-funnel-udf
  Hive UDFs for funnel analysis
  ☆84Updated 2 years ago
• mtth / azkaban
  Lightweight Azkaban client
  ☆77Updated 5 years ago
• justonedb / kafka-sink-pg-json
  Kafka sink connector for streaming messages to PostgreSQL
  ☆92Updated 4 years ago
• pipelinedb / pipeline_kafka
  PipelineDB extension for Kafka support
  ☆62Updated 6 years ago
• sailthru / stolos
  A Directed Acyclic Graph task dependency scheduler designed to simplify complex distributed pipelines
  ☆131Updated 7 years ago
• phunt / zookeeper_dashboard
  Django based dashboard for an Apache ZooKeeper cluster.
  ☆165Updated 8 years ago
• Aloisius / hadoop-s3a
  An AWS SDK-backed FileSystem driver for Hadoop
  ☆64Updated 4 years ago
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 5 years ago
• RedisLabsModules / redisml
  Machine Learning Model Server
  ☆308Updated 6 years ago
• sentric / hannibal
  Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.
  ☆172Updated 7 years ago