laserson / avro2parquetLinks
Hadoop MapReduce tool to convert Avro data files to Parquet format.
☆34Updated 12 years ago
Alternatives and similar repositories for avro2parquet
Users that are interested in avro2parquet are comparing it to the libraries listed below
Sorting:
- Remedy small files by combining them into larger ones.☆194Updated 3 years ago
- Helpful user defined fuctions / table generating functions for Hive☆101Updated 9 years ago
- Low level integration of Spark and Kafka☆130Updated 7 years ago
- Cascading on Apache Flink®☆54Updated last year
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Kite SDK Examples☆99Updated 4 years ago
- NRT Sessionization with Spark Streaming landing on HDFS and putting live stats in HBase☆50Updated 11 years ago
- Write your Spark data to Kafka seamlessly☆174Updated last year
- An example Apache Beam project.☆111Updated 8 years ago
- A High Performance Cluster Consumer for Kafka that creates Avro (boom) files in Hadoop in time based directory paths☆42Updated 9 years ago
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆119Updated 9 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 12 years ago
- spark + drools☆103Updated 3 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆63Updated last year
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50Updated 9 years ago
- Mirror of Apache Apex malhar☆133Updated 6 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆161Updated 3 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- Real-time aggregation of metrics from large distributed systems.☆106Updated 7 years ago
- A connector for SingleStore and Spark☆162Updated 2 months ago
- Spark, Spark Streaming and Spark SQL unit testing strategies☆216Updated 9 years ago
- ☆56Updated 11 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆240Updated 10 years ago
- Google Dataflow Runner for Apache Flink™ (deprecated; please use the up-to-date Beam Runner)☆88Updated 9 years ago
- Druid indexing plugin for using Spark in batch jobs☆101Updated 4 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 10 years ago
- SequenceIQ Hadoop examples☆115Updated 10 years ago
- ☆76Updated 10 years ago
- ElasticSearch integration for Apache Spark☆47Updated 9 years ago
- SQL for Kafka Connectors☆99Updated last year