Alternatives and similar repositories for data_pipeline_avro_util

Users that are interested in data_pipeline_avro_util are comparing it to the libraries listed below

• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 2 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated last year
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 8 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• cdapio / coopr
  A template-based cluster provisioning system
  ☆61Updated 2 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆98Updated 8 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 7 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆69Updated last year
• TIBCOSoftware / snappy-examples
  Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.
  ☆32Updated 2 years ago
• harelba / tail2kafka
  Tail a log file and send log lines automatically to a kafka topic
  ☆57Updated 13 years ago
• etsy / Sahale
  A Cascading Workflow Visualizer
  ☆83Updated 2 years ago
• Hurence / logisland
  Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Str…
  ☆107Updated last year
• memsql / memsql-docker-quickstart
  A docker image for testing MemSQL + MemSQL Ops
  ☆68Updated 2 years ago
• gautamborad / hdp-ansible
  Automated (Ansible) installation of HDP via Ambari Blueprint
  ☆16Updated 8 years ago
• uber / uberscriptquery
  UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy
  ☆61Updated last year
• implydata / datazoo
  A collection of datasets and databases
  ☆24Updated 7 years ago
• snowplow / sql-runner
  Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
  ☆81Updated last month
• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 8 years ago
• keenlabs / capillary
  Storm Spout + Kafka State Inspector
  ☆58Updated 5 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 10 years ago
• Impetus / jumbune
  Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…
  ☆70Updated 2 years ago
• bullet-db / bullet-core
  Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…
  ☆41Updated 2 years ago
• stripe-archive / herringbone
  Tools for working with parquet, impala, and hive
  ☆134Updated 4 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• qubole / kinesis-storage-handler
  Hive Storage Handler for Kinesis.
  ☆11Updated 10 years ago
• stitchfix / s3drive
  S3 backed ContentsManager for jupyter notebooks
  ☆14Updated 9 years ago