rbystrit / avro_gen
Avro record class and reader generator
☆20Updated 2 years ago
Alternatives and similar repositories for avro_gen:
Users that are interested in avro_gen are comparing it to the libraries listed below
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- Scripts for parsing / making sense of yarn logs☆52Updated 8 years ago
- A Giter8 template for scio☆31Updated 2 months ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated 3 months ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 5 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Example for experimenting with how JupyterHub can be configured to work with Kerberos☆33Updated 7 years ago
- Filling in the Spark function gaps across APIs☆50Updated 4 years ago
- Nested array transformation helper extensions for Apache Spark☆37Updated last year
- Apache (Py)Spark type annotations (stub files).☆117Updated 2 years ago
- Jupyter extensions for SWAN☆58Updated this week
- Example projects for using Spark and Cassandra With DSE Analytics☆58Updated last year
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- A client for the Confluent Schema Registry API implemented in Python☆53Updated 2 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated last month
- Hadoop output committers for S3☆109Updated 4 years ago
- Big Data Toolkit for the JVM☆146Updated 4 years ago
- The iterative broadcast join example code.☆69Updated 7 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated last year
- functionstest☆33Updated 8 years ago
- Monitor Apache Spark from Jupyter Notebook☆172Updated 2 years ago
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆38Updated 2 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆109Updated 7 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 7 months ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 5 months ago
- Basic framework utilities to quickly start writing production ready Apache Spark applications☆36Updated 4 months ago