Alternatives and similar repositories for spark-records

Users that are interested in spark-records are comparing it to the libraries listed below

• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• airbnb / sputnik
  ☆63Updated 5 years ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated 2 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated this week
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 10 months ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 5 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated 10 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆70Updated 7 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 4 years ago
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆71Updated last month
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last month
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• hammerlab / yarn-logs-helpers
  Scripts for parsing / making sense of yarn logs
  ☆52Updated 8 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 5 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆91Updated 2 months ago
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆38Updated 2 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 7 months ago
• bloomberg / spark-flow
  Library for organizing batch processing pipelines in Apache Spark
  ☆42Updated 8 years ago
• radanalyticsio / silex
  something to help you spark
  ☆65Updated 6 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 8 months ago
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆96Updated 5 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 9 years ago
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆146Updated 4 years ago