DhiaTN / confluent-avro-pyLinks
An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format
☆22Updated 5 years ago
Alternatives and similar repositories for confluent-avro-py
Users that are interested in confluent-avro-py are comparing it to the libraries listed below
Sorting:
- Ansible role to deploy and configure Airflow☆41Updated this week
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆37Updated 5 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Updated 2 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 2 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 6 years ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 7 months ago
- A curated list of awesome resources for Apache Beam☆145Updated 3 years ago
- A client for the Confluent Schema Registry API implemented in Python☆21Updated 7 years ago
- Apache (Py)Spark type annotations (stub files).☆118Updated 3 years ago
- An example mini data warehouse for python project stats, template for new projects☆178Updated 5 years ago
- A pyspark lib to validate data quality☆18Updated 3 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆152Updated 8 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 2 weeks ago
- Python implementation of KillrVideo service layer☆31Updated 2 years ago
- Tool for exploring data on an Apache Kafka cluster☆42Updated 5 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- A short course on the new, experimental features by The Data Incubator and O'Reilly Strata.☆16Updated 8 years ago
- A python wrapper for the KSQL REST API.☆158Updated 2 years ago
- Oh you know, just a coupla, two, tree Kafka Streams in Scala☆24Updated 4 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 5 years ago
- A daily digest of the articles or videos I've found interesting, that I want to share with you.☆325Updated this week
- Curated by Lenses.io☆307Updated 5 years ago
- ☆54Updated 8 years ago
- Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code☆296Updated 11 months ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Some class materials for a data processing course using PySpark☆52Updated 3 years ago