miguno / avro-cli-examples
Examples on how to use the command line tools in Avro Tools to read and write Avro files
☆152Updated 4 months ago
Related projects: ⓘ
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆118Updated 8 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆97Updated 5 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 3 years ago
- SQL for Kafka Connectors☆96Updated 8 months ago
- Integration tests for Spark☆69Updated last year
- Apache Spark and Apache Kafka integration example☆124Updated 6 years ago
- A library to expose more of Apache Spark's metrics system☆146Updated 4 years ago
- Wikipedia stream-processing demo using Kafka Connect and Kafka Streams.☆75Updated 6 years ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 3 years ago
- The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.☆155Updated 2 years ago
- ☆57Updated this week
- Spark, Spark Streaming and Spark SQL unit testing strategies☆218Updated 7 years ago
- Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed☆23Updated 9 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆64Updated 4 years ago
- An Apache access log parser written in Scala☆72Updated 3 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆241Updated 9 years ago
- Hadoop output committers for S3☆108Updated 4 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆106Updated 6 years ago
- A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.☆42Updated 9 months ago
- A full example of my blog post regarding Sparks stateful streaming (http://asyncified.io/2016/07/31/exploring-stateful-streaming-with-apa…☆34Updated 7 years ago
- Big Data Toolkit for the JVM☆145Updated 3 years ago
- Kafka Connect Tooling☆118Updated 3 years ago
- Elastic Search on Spark☆112Updated 9 years ago
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆155Updated 6 months ago
- Kite SDK Examples☆99Updated 3 years ago
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 4 years ago
- Write your Spark data to Kafka seamlessly☆176Updated 2 months ago
- ☆78Updated 9 years ago