hammerlab / spark-util

Related projects ⓘ

Alternatives and complementary repositories for spark-util

• BenFradet / struct-type-encoder
  Deriving Spark DataFrame schemas from case classes
  ☆44Updated 4 months ago
• hammerlab / spark-tests
  Utilities for writing tests that use Apache Spark.
  ☆24Updated 5 years ago
• dwestheide / kontextfrei
  Writing application logic for Spark jobs that can be unit-tested without a SparkContext
  ☆76Updated 5 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• univalence / spark-tools
  ☆44Updated 4 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆28Updated 4 years ago
• radanalyticsio / silex
  something to help you spark
  ☆65Updated 6 years ago
• jupyter-scala / ammonium
  Impatient fork of Ammonite
  ☆62Updated 6 years ago
• nevillelyh / shapeless-datatype
  Shapeless utilities for common data types
  ☆67Updated this week
• sbt / sbt-pom-reader
  Translates xml -> awesome. Maven-ish support for sbt.
  ☆76Updated 8 months ago
• julianpeeters / case-class-generator
  Dynamically defines and loads Scala classes at runtime. Useful for turning JSON schemas into Scala case classes on the fly.
  ☆44Updated 9 years ago
• non / clouseau
  Discover java object sizes through questionable sleuthing plus luck.
  ☆67Updated 6 years ago
• gm-spacagna / sparkz
  An extension to the amazing Spark framework for better functional programming.
  ☆28Updated 8 years ago
• emmalanguage / emma
  A quotation-based Scala DSL for scalable data analysis.
  ☆63Updated 2 years ago
• hammerlab / magic-rdds
  Miscellaneous functionality for manipulating Apache Spark RDDs.
  ☆22Updated 5 years ago
• nevillelyh / parquet-extra
  A collection of Apache Parquet add-on modules
  ☆29Updated this week
• sksamuel / sbt-avro4s
  Sbt plugin for avro4s
  ☆20Updated 6 years ago
• quantifind / Sumac
  Argument parsing in Scala
  ☆84Updated last year
• tixxit / framian
  Framian
  ☆115Updated 6 years ago
• sbt / sbt-s3
  sbt-s3 is a simple sbt plugin to manipulate objects on Amazon S3
  ☆63Updated 3 years ago
• audienceproject / crossbow
  Single node, in-memory DataFrame analytics library.
  ☆38Updated last month
• viktorklang / scala-futures
  My experiments improving Scala's Future for Scala 2.12 and beyond
  ☆34Updated 6 years ago
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• iheartradio / thomas
  Another A/B test library
  ☆24Updated last week
• alvinj / SbtSubProjectsExample
  An example of using sub-projects in a Scala/SBT project
  ☆35Updated 7 years ago