rdblue / parquet-avro-protobuf
Example: Convert Protobuf to Parquet using parquet-avro and avro-protobuf
☆29Updated 8 years ago
Related projects: ⓘ
- Cascading on Apache Flink®☆54Updated 7 months ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆49Updated 8 months ago
- Simple Samza Job Using Confluent Platform☆15Updated 8 years ago
- Use SQL to transform your avro schema/records☆28Updated 6 years ago
- SQL for Kafka Connectors☆96Updated 8 months ago
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 6 months ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated 6 months ago
- ☆18Updated this week
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 3 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 3 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆59Updated 9 months ago
- ☆22Updated 5 years ago
- ☆14Updated this week
- Experiments with the GDELT dataset and Cassandra schemas.☆25Updated 8 years ago
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆37Updated 2 years ago
- Utility project for working with Kafka Connect.☆34Updated last month
- Demonstration of a Hive Input Format for Iceberg☆26Updated 3 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 8 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 5 years ago
- Schema Registry integration for Apache Spark☆39Updated last year
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 5 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 8 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated last year
- A utility for generating Oozie workflows from a YAML definition☆48Updated 5 years ago
- Graph Analytics with Apache Kafka☆101Updated this week
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 2 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Fast Apache Avro serialization/deserialization library☆43Updated 3 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆97Updated 5 years ago