linkedin / python-avro-json-serializer
Serializes data into a JSON format using AVRO schema.
☆137Updated 3 years ago
Alternatives and similar repositories for python-avro-json-serializer
Users that are interested in python-avro-json-serializer are comparing it to the libraries listed below
Sorting:
- A client for the Confluent Schema Registry API implemented in Python☆53Updated 2 years ago
- Pure Python wrapper for the Hadoop WebHDFS Rest API☆52Updated 4 years ago
- Utils around luigi.☆66Updated 4 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated 5 months ago
- python JSON log formatter with a logstash compatible schema☆158Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 2 years ago
- Battle-tested Apache Storm Multi-Lang implementation for Python☆70Updated 2 years ago
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- Python Driver for Apache Drill.☆59Updated 2 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆136Updated 4 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆87Updated 4 years ago
- Spotify's Luigi + Amazon's SWF integration☆16Updated 9 years ago
- A client for the Confluent Schema Registry API implemented in Python☆21Updated 6 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- A Python implementation of Apache Kafka Streams☆311Updated 6 years ago
- Helpers & syntactic sugar for PySpark.☆62Updated last year
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆261Updated last year
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆269Updated 8 months ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆234Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- A tool and library for easily deploying applications on Apache YARN☆143Updated last year
- python implementation of the parquet columnar file format.☆21Updated last month
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- ☆54Updated 7 years ago
- Provides a Pythonic interface for reading and writing Avro schemas☆27Updated 2 years ago
- Performance metrics, based on Coda Hale's Yammer metrics☆196Updated last year