data-tools / big-data-typesLinks
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
☆13Updated 2 weeks ago
Alternatives and similar repositories for big-data-types
Users that are interested in big-data-types are comparing it to the libraries listed below
Sorting:
- Optics for Spark DataFrames☆47Updated 4 years ago
- Type safety for spark columns☆78Updated 2 weeks ago
- EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Goo…☆44Updated last year
- Single node, in-memory DataFrame analytics library.☆43Updated last month
- ☆105Updated 4 months ago
- ☆36Updated 3 years ago
- ☆45Updated 5 years ago
- SparkSQL utils for ScalaPB☆43Updated 4 months ago
- A collection of Magnolia add-on modules☆179Updated 2 weeks ago
- Shapeless utilities for common data types☆67Updated this week
- Scala 3.x wrapper for Apache Flink☆50Updated 2 years ago
- Scala ADT support for Apache Flink☆52Updated last year
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆76Updated 6 years ago
- Lego bricks to build Apache Kafka serializers and deserializers☆120Updated 2 years ago
- A schema-aware Scala library for data transformation☆87Updated last year
- Flink Scala API is a thin wrapper on top of Flink Java API which support Scala Types for serialisation as well the latest Scala version☆103Updated this week
- A functional wrapper around Spark to make it works with ZIO☆50Updated last week
- A simple graph library for Scala☆10Updated 3 years ago
- Typesafe wrapper for Apache Spark DataFrame API☆141Updated 2 weeks ago
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 4 years ago
- Deriving Spark DataFrame schemas from case classes☆44Updated last year
- Declarative Data Viz 4 Scala☆53Updated 5 months ago
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 7 years ago
- Functional programming with Kafka and Scala☆98Updated last week
- Nested array transformation helper extensions for Apache Spark☆37Updated 2 years ago
- ☆35Updated 3 years ago
- ☆10Updated 4 months ago
- A fork of Apache Flink scala bindings for 2.12, 2.13 and 3.x☆21Updated last year
- Generic Serdes with Circe for Kafka Streams☆29Updated 3 years ago
- Run spark calculations from Ammonite☆117Updated 2 weeks ago