rdblue / parquet-avro-protobuf
Example: Convert Protobuf to Parquet using parquet-avro and avro-protobuf
☆30Updated 9 years ago
Alternatives and similar repositories for parquet-avro-protobuf:
Users that are interested in parquet-avro-protobuf are comparing it to the libraries listed below
- A library for Spark DataFrame using MinIO Select API☆97Updated 5 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆38Updated 2 years ago
- Cascading on Apache Flink®☆54Updated last year
- Use SQL to transform your avro schema/records☆28Updated 7 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 5 years ago
- Fast Apache Avro serialization/deserialization library☆43Updated 4 years ago
- Sketch adaptors for Hive.☆50Updated 3 weeks ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆62Updated last year
- Tool for exploring data on an Apache Kafka cluster☆42Updated 4 years ago
- Splittable Gzip codec for Hadoop☆70Updated 2 weeks ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Presto ODBC Driver☆27Updated 10 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆50Updated last year
- A collection of libraries for single-pass, distributed, sublinear-space approximate aggregation and sketching algorithms. Currently: Hype…☆155Updated 2 years ago
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 5 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- Druid indexing plugin for using Spark in batch jobs☆101Updated 3 years ago
- A protobuf schema registry on steroids. It will keep track of the contracts throughout your organization, making sure no contract is brok…☆43Updated 4 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- Google Dataflow Runner for Apache Flink™ (deprecated; please use the up-to-date Beam Runner)☆88Updated 8 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- GCS support for avro-tools, parquet-tools and protobuf☆74Updated last month
- Easy CPU Profiling for Apache Spark applications☆45Updated 4 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- ☆22Updated 5 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 9 years ago
- An ORC File Scheme for the Cascading data processing platform.☆14Updated 3 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- ☆105Updated last year