Yelp / data_pipeline_avro_util
Provides a Pythonic interface for reading and writing Avro schemas
☆27Updated 2 years ago
Alternatives and similar repositories for data_pipeline_avro_util:
Users that are interested in data_pipeline_avro_util are comparing it to the libraries listed below
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆87Updated 4 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Updated last year
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆46Updated last year
- Extensions, custom & experimental panels☆52Updated 9 years ago
- A scalable, distributed Time Series Database.☆28Updated 10 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- A collection of datasets and databases☆24Updated 6 years ago
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Dump mysql tables to s3, and parse them☆31Updated 10 years ago
- Hive Storage Handler for Kinesis.☆11Updated 9 years ago
- Luigi Plugin for Hubot☆35Updated 8 years ago
- Tail a log file and send log lines automatically to a kafka topic☆57Updated 12 years ago
- Python client for Spark Jobserver Rest API☆39Updated 4 years ago
- Apache Spark AWS Lambda Executor (SAMBA)☆44Updated 6 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆253Updated 9 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 8 years ago
- A DC/OS time series demo☆62Updated 9 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆20Updated 4 months ago
- Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…☆71Updated 2 years ago
- Herd-UI is a search and discovery tool for business and technical users. Everyone in your organization can use Herd-UI to browse and unde…☆16Updated 2 years ago
- Storm Spout + Kafka State Inspector☆58Updated 5 years ago
- Real time and offline time series analysis with Spark, Spark Streaming and Storm☆21Updated 4 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆62Updated last year
- spark-emr☆15Updated 10 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago