data-tools / big-data-types
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
☆12Updated this week
Related projects ⓘ
Alternatives and complementary repositories for big-data-types
- Optics for Spark DataFrames☆47Updated 3 years ago
- SparkSQL utils for ScalaPB☆43Updated 2 weeks ago
- EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Goo…☆43Updated 2 months ago
- Single node, in-memory DataFrame analytics library.☆38Updated last month
- ☆35Updated 2 years ago
- A distributed fake data generator based in Akka.☆94Updated 4 years ago
- Flink Scala API is a thin wrapper on top of Flink Java API which support Scala Types for serialisation as well the latest Scala version☆68Updated last week
- A library that brings useful functions from various modern database management systems to Apache Spark☆56Updated last year
- ☆9Updated 2 years ago
- A functional wrapper around Spark to make it works with ZIO☆42Updated this week
- Scala 3.x wrapper for Apache Flink☆49Updated last year
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 6 years ago
- Scala ADT support for Apache Flink☆51Updated 3 months ago
- ☆89Updated 10 months ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆30Updated 2 weeks ago
- A schema-aware Scala library for data transformation☆86Updated 9 months ago
- Nested array transformation helper extensions for Apache Spark☆36Updated last year
- Type safety for spark columns☆77Updated 2 weeks ago
- ▶️ GitHub Action using Coursier to install JVM and Scala tools☆55Updated this week
- sbt plugin for GitHub Packages, publish packaged jars or remote cache artifacts☆14Updated 2 months ago
- Template for Spark Projects☆101Updated 6 months ago
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- ☆44Updated 4 years ago
- A fork of Apache Flink scala bindings for 2.12, 2.13 and 3.x☆20Updated 3 months ago
- Run spark calculations from Ammonite☆118Updated 3 months ago
- Simple retry functionality for Scala☆21Updated 2 years ago
- Functional programming with Kafka and Scala☆92Updated 2 weeks ago
- ☆9Updated 5 years ago
- Deriving Spark DataFrame schemas from case classes☆44Updated 5 months ago