Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
☆70May 8, 2023Updated 2 years ago
Alternatives and similar repositories for spark-bigquery
Users that are interested in spark-bigquery are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Google BigQuery support for Spark, SQL, and DataFrames☆156Dec 14, 2019Updated 6 years ago
- Google BigQuery data source for Apache Spark☆17Oct 1, 2024Updated last year
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Sep 29, 2018Updated 7 years ago
- ☆31Oct 17, 2018Updated 7 years ago
- IPython magics to work with DBT☆15Jul 22, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.☆14Mar 17, 2021Updated 5 years ago
- ScalikeJDBC extension for Google BigQuery☆18Mar 15, 2020Updated 6 years ago
- Google BigQuery API using service account credentials.☆21Feb 22, 2016Updated 10 years ago
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- ☆45Apr 27, 2020Updated 5 years ago
- This project includes various scripts for Ensage.☆11Jan 5, 2015Updated 11 years ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Apr 18, 2017Updated 8 years ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆422Updated this week
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Dec 13, 2017Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Shapeless utilities for common data types☆67Updated this week
- Replicates data between Google Cloud BigQuery projects☆22Jul 13, 2016Updated 9 years ago
- Hadoop InputFormat for http://druid.io/☆10Oct 26, 2016Updated 9 years ago
- Singer tap for getting CSV and XLS(X) data out of Amazon S3☆12Feb 12, 2025Updated last year
- Hive Storage Handler for interoperability between BigQuery and Apache Hive☆19Jan 29, 2025Updated last year
- Bigquery bundle for Apache NiFi☆15Apr 20, 2019Updated 6 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Aug 17, 2015Updated 10 years ago
- Dockerfile for Apache Zeppelin☆17Dec 9, 2015Updated 10 years ago
- A disciplined way to purely functional domain models in Scala☆29Aug 12, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Generate GitHub Actions matrix on the fly based on your constraints☆12Apr 1, 2024Updated last year
- Apache Calcite Adapter for Apache Kudu☆28Sep 26, 2025Updated 6 months ago
- ☆30Mar 7, 2025Updated last year
- an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore☆16Mar 22, 2017Updated 9 years ago
- Python Environment Variables Manager☆10Jun 18, 2016Updated 9 years ago
- A Singer (https://singer.io) target that writes data to Google BigQuery.☆40Mar 8, 2021Updated 5 years ago
- ☆11Jun 4, 2021Updated 4 years ago
- Better bridge apache spark and postgresql☆23Sep 11, 2023Updated 2 years ago
- Tutorials, Examples about Kubeflow Pipeline.☆13Nov 21, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆67Aug 16, 2024Updated last year
- This repository is deprecated. All of its content and history has been moved to googleapis/google-cloud-node.☆12Jul 13, 2023Updated 2 years ago
- An Apache FreeMarker template resolver for the sbt new command☆12Aug 12, 2017Updated 8 years ago
- Coursera Machine Learning class examples in Spark☆43Feb 14, 2014Updated 12 years ago
- Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)☆24Dec 30, 2019Updated 6 years ago
- Code to munge data between Kaggle .tsv Rotten Tomatoes Sentiment Analysis data set and Vowpal Wabbit☆24Jun 22, 2014Updated 11 years ago
- Apache training☆35Feb 11, 2026Updated last month