spotify / big-data-rosetta-code

Related projects ⓘ

Alternatives and complementary repositories for big-data-rosetta-code

• spotify / ratatool
  A tool for data sampling, data generation, and data diffing
  ☆341Updated last month
• spotify / featran
  A Scala feature transformation library for data science and machine learning
  ☆467Updated 2 months ago
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 4 years ago
• juanrh / sscheck
  ScalaCheck for Spark
  ☆63Updated 6 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆108Updated 6 years ago
• spotify / noether
  Scala Aggregators used for ML Model metrics monitoring
  ☆91Updated last year
• saurfang / sbt-spark-submit
  sbt plugin for spark-submit
  ☆96Updated 7 years ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆101Updated 6 months ago
• typelevel / frameless
  Expressive types for Spark.
  ☆879Updated this week
• lightbend / kafka-streams-scala
  Thin Scala wrapper around Kafka Streams Java API
  ☆190Updated last year
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆145Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• groupon / sparklint
  A tool for monitoring and tuning Spark jobs for efficiency.
  ☆357Updated 2 years ago
• spotify / gcs-tools
  GCS support for avro-tools, parquet-tools and protobuf
  ☆73Updated 2 weeks ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• samthebest / dump
  Dumping ground for random stuff
  ☆55Updated 8 months ago
• mrpowers-io / spark-fast-tests
  Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
  ☆436Updated last week
• vegas-viz / Vegas
  The missing MatPlotLib for Scala + Spark
  ☆730Updated 2 years ago
• MrPowers / spark-sbt.g8
  A giter8 template for Spark SBT projects
  ☆72Updated 3 years ago
• samelamin / spark-bigquery
  Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
  ☆70Updated last year
• mjakubowski84 / parquet4s
  Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
  ☆283Updated last week
• manub / scalatest-embedded-kafka
  A library that provides an in-memory Kafka instance to run your tests against.
  ☆295Updated 5 years ago
• Hydrospheredata / mist
  Serverless proxy for Spark cluster
  ☆326Updated 4 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• awesome-spark / spark-gotchas
  Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
  ☆359Updated 7 years ago
• mkuthan / example-spark
  Spark, Spark Streaming and Spark SQL unit testing strategies
  ☆219Updated 8 years ago
• saurfang / sparksql-protobuf
  Read SparkSQL parquet file as RDD[Protobuf]
  ☆93Updated 6 years ago