Yelp / data_pipeline_avro_utilLinks
Provides a Pythonic interface for reading and writing Avro schemas
☆27Updated 2 years ago
Alternatives and similar repositories for data_pipeline_avro_util
Users that are interested in data_pipeline_avro_util are comparing it to the libraries listed below
Sorting:
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆87Updated 4 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Updated last year
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- A collection of datasets and databases☆24Updated 7 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)☆47Updated last year
- Tail a log file and send log lines automatically to a kafka topic☆57Updated 12 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Extensions, custom & experimental panels☆53Updated 9 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Cloudbreak Deployer Tool☆34Updated last year
- Example using Grafana with Druid☆11Updated 10 years ago
- Dump mysql tables to s3, and parse them☆31Updated 10 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 9 years ago
- ☆42Updated 2 years ago
- A scalable, distributed Time Series Database.☆28Updated 10 years ago
- Muppet☆126Updated 4 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆61Updated last year
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Herd-UI is a search and discovery tool for business and technical users. Everyone in your organization can use Herd-UI to browse and unde…☆16Updated 2 years ago
- Hive Storage Handler for Kinesis.☆11Updated 10 years ago
- A template-based cluster provisioning system☆61Updated 2 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 2 weeks ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 6 months ago