Alternatives and similar repositories for spark-bigquery

Users that are interested in spark-bigquery are comparing it to the libraries listed below

• samelamin / spark-bigquery
  Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
  ☆70Updated 2 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 3 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• TrueCar / mleap
  MLeap allows for easily putting Spark ML pipelines into production
  ☆78Updated 8 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• snowplow-archive / spark-example-project
  A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
  ☆118Updated 9 years ago
• hammerlab / spree
  Live-updating Spark UI built with Meteor
  ☆189Updated 4 years ago
• rdblue / s3committer
  Hadoop output committers for S3
  ☆109Updated 4 years ago
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆96Updated 5 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• GoogleCloudPlatform / DataflowPythonSDK
  Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
  ☆163Updated 8 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• intentmedia / mario
  Functional, Typesafe, Declarative Data Pipelines
  ☆139Updated 7 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• bythebay / pipeline
  Complete Pipeline Training at Big Data Scala By the Bay
  ☆71Updated 9 years ago
• spotify / featran
  A Scala feature transformation library for data science and machine learning
  ☆468Updated 3 months ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 11 months ago
• juanrh / sscheck
  ScalaCheck for Spark
  ☆63Updated 7 years ago
• spotify / ratatool
  A tool for data sampling, data generation, and data diffing
  ☆342Updated last month
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆146Updated 4 years ago
• saurfang / sbt-spark-submit
  sbt plugin for spark-submit
  ☆96Updated 7 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• kawaa / Beetest
  A super simple utility for testing Apache Hive scripts locally for non-Java developers.
  ☆72Updated 8 years ago
• spotify / gcs-tools
  GCS support for avro-tools, parquet-tools and protobuf
  ☆75Updated 3 weeks ago
• knockdata / spark-highcharts
  Support Highcharts in Apache Zeppelin
  ☆81Updated 7 years ago
• GoogleCloudDataproc / hadoop-connectors
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
  ☆285Updated this week
• groupon / sparklint
  A tool for monitoring and tuning Spark jobs for efficiency.
  ☆358Updated 2 years ago