miraisolutions / spark-bigquery
Google BigQuery data source for Apache Spark
☆17Updated 5 months ago
Alternatives and similar repositories for spark-bigquery:
Users that are interested in spark-bigquery are comparing it to the libraries listed below
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 5 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated last year
- A giter8 template for Spark SBT projects☆72Updated 4 years ago
- Kinesis Connector for Structured Streaming☆136Updated 8 months ago
- A handy Scala wrapper of Google BigQuery API 's Java Client Library.☆34Updated 6 years ago
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆283Updated this week
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆185Updated 2 years ago
- ☆31Updated 6 years ago
- Avro SerDe for Apache Spark structured APIs.☆232Updated 8 months ago
- ScalaCheck for Spark☆63Updated 6 years ago
- sbt plugin for generating Scala sources for Apache Avro schemas and protocols.☆132Updated last month
- GCS support for avro-tools, parquet-tools and protobuf☆74Updated last month
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- Scala port of ua-parser☆99Updated this week
- ScalikeJDBC extension for Google BigQuery☆18Updated 5 years ago
- A Giter8 template for scio☆31Updated last month
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆195Updated this week
- Shapeless utilities for common data types☆67Updated this week
- Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.☆286Updated last month
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 3 years ago
- SBT plugin for Apache Spark on AWS EMR☆57Updated 6 years ago
- Hadoop output committers for S3☆108Updated 4 years ago
- SparkSQL utils for ScalaPB☆44Updated last week
- sbt plugin for spark-submit☆96Updated 7 years ago
- scalastyle-sbt-plugin☆139Updated 5 years ago
- Template for Spark Projects☆101Updated 10 months ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Amazon S3-based resolver for sbt☆118Updated 6 years ago
- Dockerfile for sbt (Scala build tool)☆126Updated last year