MartinSahlen / bq-utilsLinks
Utitilties for BigQuery such as downloading table / query to csv/ndjson/excel/gsheet or new table using iterators for a low memory footprint.
☆13Updated 8 years ago
Alternatives and similar repositories for bq-utils
Users that are interested in bq-utils are comparing it to the libraries listed below
Sorting:
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43Updated 9 years ago
- ☆54Updated 7 years ago
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Cloud Pub/Sub sample applications with Python☆72Updated 8 years ago
- A Singer.io Target for the Stitch Import API☆26Updated 2 weeks ago
- A tool for moving tables from Redshift to BigQuery☆65Updated 6 years ago
- JSON -> Relational DB Column Types☆63Updated 2 years ago
- Utils around luigi.☆66Updated 4 years ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 8 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- Dockerfile for Apache Zeppelin☆17Updated 9 years ago
- A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub☆67Updated 7 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- A Node.js REST interface for an Apache Spark REPL which can execute JavaScript.☆17Updated 9 years ago
- A mulitarmed bandit to A/B test go projects, or other languages via an API.☆71Updated 11 years ago
- BigQuery Manager☆11Updated 4 years ago
- Luigi Workflow Engine integration for Treasure Data☆16Updated 7 years ago
- Docker container to make running Luigi tasks real easy.☆11Updated 8 years ago
- Bulk loader for Elasticsearch from a Postgres database☆27Updated 9 years ago
- Python bindings for TrailDB☆39Updated 5 years ago
- Chatlytics is a data query and visualization platform for chat!☆13Updated 8 years ago
- A Go library for working with Table Schema.☆46Updated 2 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 6 years ago
- A javascript shell for elasticsearch☆105Updated 10 years ago
- Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow☆58Updated 4 years ago
- An open source library for BigQuery testing.☆14Updated 3 years ago
- Processing Logs at Scale using Cloud Dataflow☆61Updated 6 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- ☆9Updated 2 weeks ago