imduffy15 / spark-avro-compactorLinks
Spark job for compacting avro files together
☆12Updated 7 years ago
Alternatives and similar repositories for spark-avro-compactor
Users that are interested in spark-avro-compactor are comparing it to the libraries listed below
Sorting:
- HDFS compatible Distributed Filesystem backed Cassandra☆25Updated 9 years ago
- Library offering http based query on top of Kafka Streams Interactive Queries☆69Updated 2 years ago
- Embedded Kafka for testing and quick prototyping.☆14Updated 9 years ago
- Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.☆23Updated 7 years ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Updated 4 years ago
- ☆50Updated 4 years ago
- Thin Scala wrapper for the Kafka Streams API☆49Updated 7 years ago
- A fast, streaming-friendly, type-safe, pure-Scala MessagePack library. Supercharge your microservices today!☆60Updated 3 years ago
- Easy way to send Finagle metrics to Codahale Metrics library☆41Updated 5 years ago
- Fault tolerant distributed task scheduler.☆40Updated 5 years ago
- Docker images to build and generate native artifacts using GraalVM☆59Updated 7 years ago
- Native non-blocking client for ZooKeeper with Finagle☆54Updated 10 years ago
- Use Cascading Taps and Scalding DSL with Spark☆49Updated 8 years ago
- SparkSQL utils for ScalaPB☆43Updated this week
- Used to generate mock Avro data☆15Updated 6 years ago
- ☆36Updated 2 years ago
- ☆14Updated 8 years ago
- ☆26Updated 5 years ago
- Domain-specific language to help build and maintain AWS Data Pipelines☆26Updated 6 years ago
- functionstest☆33Updated 8 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- Connector between Spark and InfluxDB.☆23Updated 9 years ago
- Simple Samza Job Using Confluent Platform☆14Updated 9 years ago
- My experiments improving Scala's Future for Scala 2.12 and beyond☆34Updated 7 years ago
- PoC using scala that defines single-message protobuf schema per Kafka topic☆23Updated 5 years ago
- Flink stream filtering examples☆19Updated 8 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29Updated 5 years ago
- Akka based asynchronous worker pool☆32Updated 9 years ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Updated 4 years ago
- Eventuate chaos testing utilities☆27Updated 6 years ago