shazam / scala-datapipeline-dsl

Related projects ⓘ

Alternatives and complementary repositories for scala-datapipeline-dsl

• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• BenFradet / struct-type-encoder
  Deriving Spark DataFrame schemas from case classes
  ☆44Updated 5 months ago
• aseigneurin / kafka-streams-scala
  Thin Scala wrapper for the Kafka Streams API
  ☆50Updated 6 years ago
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆145Updated 4 years ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆101Updated 6 months ago
• univalence / spark-tools
  ☆44Updated 4 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• hammerlab / spark-util
  low-level helpers for Apache Spark libraries and tests
  ☆16Updated 5 years ago
• scalapb / sparksql-scalapb
  SparkSQL utils for ScalaPB
  ☆43Updated this week
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆108Updated 6 years ago
• pluralsight / hydra-spark
  ☆50Updated 4 years ago
• typesafehub / fdp-modelserver
  An umbrella project for multiple implementations of model serving
  ☆46Updated 7 years ago
• juanrh / sscheck
  ScalaCheck for Spark
  ☆63Updated 6 years ago
• lightbend / kafka-streams-scala
  Thin Scala wrapper around Kafka Streams Java API
  ☆190Updated last year
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• ovotech / kafka-serialization
  Lego bricks to build Apache Kafka serializers and deserializers
  ☆119Updated last year
• snowplow / scala-maxmind-iplookups
  Scala client for MaxMind Geo-IP
  ☆86Updated 9 months ago
• MrPowers / spark-sbt.g8
  A giter8 template for Spark SBT projects
  ☆72Updated 3 years ago
• FRosner / spawncamping-dds
  Data-Driven Spark allows quick data exploration based on Apache Spark.
  ☆28Updated 7 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• sksamuel / sbt-avro4s
  Sbt plugin for avro4s
  ☆20Updated 6 years ago
• nevillelyh / shapeless-datatype
  Shapeless utilities for common data types
  ☆67Updated this week
• bythebay / pipeline
  Complete Pipeline Training at Big Data Scala By the Bay
  ☆71Updated 9 years ago