MrPowers / spark-spec

Related projects ⓘ

Alternatives and complementary repositories for spark-spec

• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆108Updated 6 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• jasonsatran / spark-meta
  Spark data profiling utilities
  ☆22Updated 6 years ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆101Updated 6 months ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 3 weeks ago
• juanrh / sscheck
  ScalaCheck for Spark
  ☆63Updated 6 years ago
• MrPowers / spark-sbt.g8
  A giter8 template for Spark SBT projects
  ☆72Updated 3 years ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 4 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 7 months ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 3 years ago
• radanalyticsio / silex
  something to help you spark
  ☆65Updated 6 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆56Updated last year
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• bosea / spark-unit-testing
  A tutorial on Apache Spark Unit Testing
  ☆37Updated 8 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated last week
• bythebay / pipeline
  Complete Pipeline Training at Big Data Scala By the Bay
  ☆71Updated 9 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆48Updated 10 months ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆60Updated 2 months ago