Alternatives and similar repositories for spark-bigquery

Users that are interested in spark-bigquery are comparing it to the libraries listed below

• spotify / spark-bigquery

  View on GitHub
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆156Dec 14, 2019Updated 6 years ago
• GoogleCloudPlatform / dataproc-pubsub-spark-streaming

  View on GitHub
  ☆31Oct 17, 2018Updated 7 years ago
• dhwajraj / spark-twitter-named-entity

  View on GitHub
  Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP
  ☆15Oct 12, 2016Updated 9 years ago
• seratch / bigquery4s

  View on GitHub
  A handy Scala wrapper of Google BigQuery API 's Java Client Library.
  ☆34Sep 29, 2018Updated 7 years ago
• erfaan / klout

  View on GitHub
  A minimalist klout API interface.
  ☆23Jan 21, 2018Updated 8 years ago
• implydata / druid-hadoop-inputformat

  View on GitHub
  Hadoop InputFormat for http://druid.io/
  ☆10Oct 26, 2016Updated 9 years ago
• lightbend / flink-operator

  View on GitHub
  Helm Chart for lyft/flinkk8soperator
  ☆11Mar 10, 2020Updated 5 years ago
• machadogj / node-google-bigquery

  View on GitHub
  Google BigQuery API using service account credentials.
  ☆21Feb 22, 2016Updated 9 years ago
• jmriego / dbt-ipy

  View on GitHub
  IPython magics to work with DBT
  ☆15Jul 22, 2022Updated 3 years ago
• pishen / minitime

  View on GitHub
  Minitime - a Java Time wrapper for Scala and Scala.js
  ☆16Jan 17, 2020Updated 6 years ago
• mdedetrich / quill-pg

  View on GitHub
  Postgres extension drivers for quill
  ☆15Oct 31, 2016Updated 9 years ago
• GoogleCloudDataproc / spark-bigquery-connector

  View on GitHub
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆420Feb 4, 2026Updated last week
• HeartSaVioR / spark-state-tools

  View on GitHub
  Spark Structured Streaming State Tools
  ☆34Jul 3, 2020Updated 5 years ago
• calrissian / spark-jetty-server

  View on GitHub
  Recipes and examples for Apache Spark
  ☆13Jan 21, 2015Updated 11 years ago
• theShadow89 / nifi-bigquery-bundle

  View on GitHub
  Bigquery bundle for Apache NiFi
  ☆15Apr 20, 2019Updated 6 years ago
• renardeinside / pyspark-logging-examples

  View on GitHub
  Writing PySpark logs in Apache Spark and Databricks
  ☆17Jun 13, 2022Updated 3 years ago
• ipedrazas / Zeppelin-docker

  View on GitHub
  Dockerfile for Apache Zeppelin
  ☆17Dec 9, 2015Updated 10 years ago
• GoogleCloudDataproc / hive-bigquery-storage-handler

  View on GitHub
  Hive Storage Handler for interoperability between BigQuery and Apache Hive
  ☆19Jan 29, 2025Updated last year
• MLWave / Kaggle_Rotten_Tomatoes

  View on GitHub
  Code to munge data between Kaggle .tsv Rotten Tomatoes Sentiment Analysis data set and Vowpal Wabbit
  ☆24Jun 22, 2014Updated 11 years ago
• GoogleCloudPlatform / spark-on-k8s-gcp-examples

  View on GitHub
  Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
  ☆37Feb 13, 2018Updated 8 years ago
• zinniasystems / spark-ml-class

  View on GitHub
  Coursera Machine Learning class examples in Spark
  ☆43Feb 14, 2014Updated 12 years ago
• searceinc / BQconvert

  View on GitHub
  BigQuery Schema Conversion Tool
  ☆23Oct 6, 2020Updated 5 years ago
• miraisolutions / sparkbq

  View on GitHub
  Sparklyr extension package to connect to Google BigQuery
  ☆19Oct 29, 2024Updated last year
• univalence / spark-tools

  View on GitHub
  ☆45Apr 27, 2020Updated 5 years ago
• bloomberg / spark-flow

  View on GitHub
  Library for organizing batch processing pipelines in Apache Spark
  ☆42Jan 4, 2017Updated 9 years ago
• twilio / calcite-kudu

  View on GitHub
  Apache Calcite Adapter for Apache Kudu
  ☆28Sep 26, 2025Updated 4 months ago
• jasonsatran / spark-meta

  View on GitHub
  Spark data profiling utilities
  ☆22Nov 24, 2018Updated 7 years ago
• s22s / pre-lt-raster-frames

  View on GitHub
  Spark DataFrames for earth observation data
  ☆19May 1, 2018Updated 7 years ago
• debussy-labs / debussy_concert

  View on GitHub
  Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…
  ☆28Mar 20, 2023Updated 2 years ago
• eastcirclek / flink-service-discovery

  View on GitHub
  Discover Flink clusters on Hadoop YARN for Prometheus
  ☆23Aug 5, 2020Updated 5 years ago
• uswitch / big-replicate

  View on GitHub
  Replicates data between Google Cloud BigQuery projects
  ☆22Jul 13, 2016Updated 9 years ago
• hortonworks-spark / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆23May 7, 2018Updated 7 years ago
• akka / akka-grpc-quickstart-scala.g8

  View on GitHub
  A minimal seed template for an Akka gRPC with Scala build
  ☆19Jan 22, 2026Updated 3 weeks ago
• nextbreakpoint / flink-controller

  View on GitHub
  Flink Controller implements a Kubernetes Custom Controller (aka Kubernetes Operator) for Apache Flink
  ☆52Jan 26, 2026Updated 2 weeks ago
• lightbend / sbt-google-cloud-storage

  View on GitHub
  A SBT resolver and publisher for Google Cloud Storage
  ☆23Dec 15, 2021Updated 4 years ago
• memsql / streamliner-examples

  View on GitHub
  Example code for building your own MemSQL Streamliner Pipelines
  ☆23Apr 18, 2017Updated 8 years ago
• kitta65 / bq-extension-vscode

  View on GitHub
  Visual Studio Code extension for GoogleSQL
  ☆24Feb 1, 2026Updated last week
• qubole / spark-acid

  View on GitHub
  ACID Data Source for Apache Spark based on Hive ACID
  ☆96Jul 7, 2021Updated 4 years ago
• tpolecat / doobie-quill

  View on GitHub
  doobie integration with quill
  ☆22Jul 8, 2019Updated 6 years ago