Alternatives and similar repositories for data_pipeline_avro_util

Users that are interested in data_pipeline_avro_util are comparing it to the libraries listed below

• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆110Updated 3 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆87Updated 4 years ago
• Yelp / yelp_kafka
  An extension of the kafka-python package that adds features like multiprocess consumers.
  ☆39Updated 2 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 6 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 9 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• jhorey / ferry
  Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
  ☆253Updated 10 years ago
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 5 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 9 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆69Updated 2 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 7 years ago
• verisign / python-confluent-schemaregistry
  A client for the Confluent Schema Registry API implemented in Python
  ☆53Updated 2 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆100Updated 8 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• sailthru / stolos
  A Directed Acyclic Graph task dependency scheduler designed to simplify complex distributed pipelines
  ☆131Updated 7 years ago
• linkedin / python-avro-json-serializer
  Serializes data into a JSON format using AVRO schema.
  ☆137Updated 3 years ago
• snowplow / snowplow-scala-analytics-sdk
  Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.
  ☆21Updated 9 months ago
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• teamclairvoyant / airflow_demo
  Airflow script for incremental data import from Mysql to Hive using Sqoop.
  ☆18Updated 7 years ago
• snowplow / sql-runner
  Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
  ☆81Updated 3 months ago
• harelba / tail2kafka
  Tail a log file and send log lines automatically to a kafka topic
  ☆57Updated 13 years ago
• quantiply / grafana-plugins
  Extensions, custom & experimental panels
  ☆53Updated 9 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆133Updated last year
• bloomreach / briefly
  Briefly - A Python Meta-programming Library for Job Flow Control
  ☆106Updated 6 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• andrewgross / json2parquet
  Convert JSON files to Parquet using PyArrow
  ☆97Updated last year
• AirSage / Petrel
  Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python
  ☆246Updated 2 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago