data-tools / big-data-typesLinks
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
☆13Updated this week
Alternatives and similar repositories for big-data-types
Users that are interested in big-data-types are comparing it to the libraries listed below
Sorting:
- Type safety for spark columns☆78Updated 2 weeks ago
- Optics for Spark DataFrames☆47Updated 4 years ago
- Single node, in-memory DataFrame analytics library.☆43Updated 2 months ago
- A collection of Magnolia add-on modules☆179Updated last week
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 7 years ago
- EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Goo…☆44Updated last year
- SparkSQL utils for ScalaPB☆43Updated 5 months ago
- Shapeless utilities for common data types☆67Updated 3 weeks ago
- ☆105Updated 4 months ago
- Functional programming with Kafka and Scala☆99Updated last week
- A schema-aware Scala library for data transformation☆87Updated last year
- A library that converts JSON Schema to Scala Case Classes☆29Updated 6 months ago
- Typesafe wrapper for Apache Spark DataFrame API☆141Updated last month
- Scala ADT support for Apache Flink☆52Updated last year
- Scala wrapper for SnakeYAML☆100Updated 3 years ago
- Lego bricks to build Apache Kafka serializers and deserializers☆120Updated 2 years ago
- A simple sbt plugin for publishing to GitHub Packages, in the style of sbt-sonatype and sbt-bintray☆178Updated last year
- Minimal, idiomatic, stream-based Scala interface for key/value store implementations☆60Updated last week
- A functional wrapper around Spark to make it works with ZIO☆52Updated last week
- Scala 3.x wrapper for Apache Flink☆50Updated 2 years ago
- SBT Plugin to ease working with JNI☆131Updated last week
- Thin Scala wrapper around Kafka Streams Java API☆189Updated 2 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆76Updated 6 years ago
- coursier sbt API and legacy sbt plugins☆42Updated last week
- ☆45Updated 5 years ago
- Kinesis Client Library Akka Stream☆32Updated last year
- Flink Scala API is a thin wrapper on top of Flink Java API which support Scala Types for serialisation as well the latest Scala version☆103Updated last week
- Template for Scala Spark with Unit Test☆13Updated 2 years ago
- Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.☆58Updated 9 months ago
- Scala Verify is a minimal testing framework for Scala. Trust, but verify.☆93Updated last month