Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
☆70May 8, 2023Updated 3 years ago
Alternatives and similar repositories for spark-bigquery
Users that are interested in spark-bigquery are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Google BigQuery support for Spark, SQL, and DataFrames☆156Dec 14, 2019Updated 6 years ago
- Google BigQuery data source for Apache Spark☆17Oct 1, 2024Updated last year
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆35Sep 29, 2018Updated 7 years ago
- Sparklyr extension package to connect to Google BigQuery☆19Oct 29, 2024Updated last year
- Java Swing in HTML5 Browser.☆29Sep 8, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- ☆46Apr 27, 2020Updated 6 years ago
- Spark Structured Streaming State Tools☆35Jul 3, 2020Updated 6 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆35Feb 13, 2018Updated 8 years ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆425Aug 22, 2026Updated last month
- Minitime - a Java Time wrapper for Scala and Scala.js☆16Jan 17, 2020Updated 6 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆26Dec 13, 2017Updated 8 years ago
- Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP☆13Oct 12, 2016Updated 9 years ago
- Postgres extension drivers for quill☆14Oct 31, 2016Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Replicates data between Google Cloud BigQuery projects☆22Jul 13, 2016Updated 10 years ago
- Hive Storage Handler for interoperability between BigQuery and Apache Hive☆19Jan 29, 2025Updated last year
- A SBT resolver and publisher for Google Cloud Storage☆23Dec 15, 2021Updated 4 years ago
- Bigquery bundle for Apache NiFi☆15Apr 20, 2019Updated 7 years ago
- My entry to the Kaggle 2013 StumbleUpon competition. Ranked 4th on the final private leaderboard.☆15Apr 23, 2014Updated 12 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Aug 17, 2015Updated 11 years ago
- Spark data profiling utilities☆23Nov 24, 2018Updated 7 years ago
- A disciplined way to purely functional domain models in Scala☆30Aug 12, 2024Updated 2 years ago
- Dockerfile for Apache Zeppelin☆17Dec 9, 2015Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Helm Chart for lyft/flinkk8soperator☆11Mar 10, 2020Updated 6 years ago
- Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector☆37Apr 18, 2023Updated 3 years ago
- Transfers inotify events from NFS server to client (for example, for MPD library auto-update)☆16Sep 16, 2013Updated 13 years ago
- Generate GitHub Actions matrix on the fly based on your constraints☆13Aug 30, 2026Updated 3 weeks ago
- Python Environment Variables Manager☆11Jun 18, 2016Updated 10 years ago
- A Singer (https://singer.io) target that writes data to Google BigQuery.☆40Mar 8, 2021Updated 5 years ago
- an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore☆16Mar 22, 2017Updated 9 years ago
- ☆11Jun 4, 2021Updated 5 years ago
- Better bridge apache spark and postgresql☆23Sep 11, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Scripts to demonstrate VPC Service Controls between tenant and shared projects☆12Jun 11, 2019Updated 7 years ago
- Tutorials, Examples about Kubeflow Pipeline.☆13Nov 21, 2022Updated 3 years ago
- Test for SparkSQL ScalaPB☆14Jun 28, 2022Updated 4 years ago
- Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)☆24Dec 30, 2019Updated 6 years ago
- ☆67Aug 16, 2024Updated 2 years ago
- This repository is deprecated. All of its content and history has been moved to googleapis/google-cloud-node.☆12Jul 13, 2023Updated 3 years ago
- An Apache FreeMarker template resolver for the sbt new command☆12Aug 12, 2017Updated 9 years ago