Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
☆70May 8, 2023Updated 3 years ago
Alternatives and similar repositories for spark-bigquery
Users that are interested in spark-bigquery are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Google BigQuery support for Spark, SQL, and DataFrames☆156Dec 14, 2019Updated 6 years ago
- Google BigQuery data source for Apache Spark☆17Oct 1, 2024Updated last year
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Sep 29, 2018Updated 7 years ago
- ☆31Oct 17, 2018Updated 7 years ago
- Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP☆15Oct 12, 2016Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- IPython magics to work with DBT☆15Jul 22, 2022Updated 3 years ago
- An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.☆14Mar 17, 2021Updated 5 years ago
- Sparklyr extension package to connect to Google BigQuery☆19Oct 29, 2024Updated last year
- ScalikeJDBC extension for Google BigQuery☆18Mar 15, 2020Updated 6 years ago
- Google BigQuery API using service account credentials.☆21Feb 22, 2016Updated 10 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27May 5, 2019Updated 7 years ago
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- ☆45Apr 27, 2020Updated 6 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆35Feb 13, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆422Updated this week
- Minitime - a Java Time wrapper for Scala and Scala.js☆16Jan 17, 2020Updated 6 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Dec 13, 2017Updated 8 years ago
- ☆22Jun 9, 2016Updated 9 years ago
- Shapeless utilities for common data types☆67Apr 29, 2026Updated last week
- A SBT resolver and publisher for Google Cloud Storage☆23Dec 15, 2021Updated 4 years ago
- Hadoop InputFormat for http://druid.io/☆10Oct 26, 2016Updated 9 years ago
- Singer tap for getting CSV and XLS(X) data out of Amazon S3☆12Feb 12, 2025Updated last year
- Helm Chart for lyft/flinkk8soperator☆11Mar 10, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Bigquery bundle for Apache NiFi☆15Apr 20, 2019Updated 7 years ago
- Spark data profiling utilities☆23Nov 24, 2018Updated 7 years ago
- My entry to the Kaggle 2013 StumbleUpon competition. Ranked 4th on the final private leaderboard.☆15Apr 23, 2014Updated 12 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Aug 17, 2015Updated 10 years ago
- Dockerfile for Apache Zeppelin☆17Dec 9, 2015Updated 10 years ago
- A disciplined way to purely functional domain models in Scala☆30Aug 12, 2024Updated last year
- Make your Spray applications simpler with Skinny components☆17Aug 20, 2016Updated 9 years ago
- Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector☆37Apr 18, 2023Updated 3 years ago
- an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore☆16Mar 22, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Singer (https://singer.io) target that writes data to Google BigQuery.☆40Mar 8, 2021Updated 5 years ago
- ☆11Jun 4, 2021Updated 4 years ago
- Tutorials, Examples about Kubeflow Pipeline.☆13Nov 21, 2022Updated 3 years ago
- Test for SparkSQL ScalaPB☆14Jun 28, 2022Updated 3 years ago
- ☆67Aug 16, 2024Updated last year
- ☆15Apr 23, 2025Updated last year
- An Apache FreeMarker template resolver for the sbt new command☆12Aug 12, 2017Updated 8 years ago