data-tools / big-data-types
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
☆13Updated 3 weeks ago
Alternatives and similar repositories for big-data-types:
Users that are interested in big-data-types are comparing it to the libraries listed below
- A collection of Magnolia add-on modules☆172Updated this week
- Optics for Spark DataFrames☆47Updated 3 years ago
- EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Goo…☆44Updated 5 months ago
- Type safety for spark columns☆77Updated this week
- Scala 3.x wrapper for Apache Flink☆49Updated last year
- Scala ADT support for Apache Flink☆51Updated 6 months ago
- Flink Scala API is a thin wrapper on top of Flink Java API which support Scala Types for serialisation as well the latest Scala version☆79Updated this week
- ☆9Updated 2 years ago
- ☆36Updated 2 years ago
- Template for Scala Spark with Unit Test☆13Updated last year
- A fork of Apache Flink scala bindings for 2.12, 2.13 and 3.x☆21Updated 6 months ago
- SparkSQL utils for ScalaPB☆43Updated this week
- Functional programming with Kafka and Scala☆94Updated this week
- Single node, in-memory DataFrame analytics library.☆38Updated 3 months ago
- A functional wrapper around Spark to make it works with ZIO☆42Updated last week
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 6 years ago
- ☆90Updated last year
- Shapeless utilities for common data types☆68Updated this week
- Generic Serdes with Circe for Kafka Streams☆28Updated 2 years ago
- The official repository for the Rock the JVM Flink course☆31Updated 2 years ago
- A schema-aware Scala library for data transformation☆86Updated 11 months ago
- Realtime feedback of Akka Stream processing via WebSockets☆16Updated 5 years ago
- Nested array transformation helper extensions for Apache Spark☆37Updated last year
- Run spark calculations from Ammonite☆119Updated 5 months ago
- Lego bricks to build Apache Kafka serializers and deserializers☆120Updated last year
- Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala☆63Updated 5 months ago
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 3 years ago
- A giter8 template for Spark SBT projects☆72Updated 3 years ago
- Template for Spark Projects☆101Updated 8 months ago
- sbt plugin for generating Scala sources for Apache Avro schemas and protocols.☆132Updated last week