miraisolutions / spark-bigquery
Google BigQuery data source for Apache Spark
☆17Updated last month
Related projects ⓘ
Alternatives and complementary repositories for spark-bigquery
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated last year
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 4 years ago
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 6 years ago
- A Giter8 template for scio☆30Updated this week
- Kinesis Connector for Structured Streaming☆137Updated 4 months ago
- ☆31Updated 6 years ago
- SparkSQL utils for ScalaPB☆43Updated 2 weeks ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆377Updated this week
- ScalaCheck for Spark☆63Updated 6 years ago
- Library for using Amazon Athena JDBC Driver with ScalikeJDBC☆21Updated last year
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆191Updated this week
- An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.☆14Updated 3 years ago
- Spark connector for SFTP☆100Updated last year
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆280Updated this week
- A giter8 template for Spark SBT projects☆72Updated 3 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- Scala port of ua-parser☆98Updated 2 months ago
- ScalikeJDBC extension for Google BigQuery☆18Updated 4 years ago
- [DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery☆46Updated last year
- Hive Storage Handler for interoperability between BigQuery and Apache Hive☆19Updated last month
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆108Updated 6 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated 9 months ago
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- Shapeless utilities for common data types☆67Updated this week
- Template for Spark Projects☆101Updated 6 months ago
- ☆54Updated 7 years ago
- SBT plugin for Apache Spark on AWS EMR☆57Updated 6 years ago
- Loads Snowplow enriched events into Google BigQuery☆21Updated this week