TristanBilot / bqfetch
A lightweight tool to fetch tables from BigQuery as pandas DataFrame very fast using BigQuery Storage API combined with multiprocessing
☆27Updated last year
Related projects ⓘ
Alternatives and complementary repositories for bqfetch
- Package for dbt that allows users to train, audit and use BigQuery ML models.☆64Updated 3 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆40Updated this week
- [DEPRECATED] A dbt adapter for Excel.☆90Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆53Updated 2 months ago
- Experimental MLflow plugin for Google Cloud Vertex AI☆37Updated 8 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆111Updated 7 months ago
- Demo of Streamlit application with Databricks SQL Endpoint☆33Updated 2 years ago
- ☆43Updated 3 months ago
- Dry run capability for dbt projects using BigQuery☆88Updated 4 months ago
- The easiest way to integrate Kedro and Great Expectations☆53Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.☆110Updated 4 months ago
- The shared semantic layer definitions that dbt-core and MetricFlow use.☆72Updated this week
- ☆48Updated 4 months ago
- Repository template to get started with Prefect Cloud & Google Cloud☆24Updated last year
- A dbt-Core package for generating models from an activity stream.☆39Updated 7 months ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆76Updated last week
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆69Updated 2 years ago
- ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to …☆42Updated last year
- ☆32Updated last year
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆24Updated last year
- Droughty helps keep your workflow dry☆63Updated 2 weeks ago
- Templates for your Kedro projects.☆67Updated this week
- Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…☆26Updated 5 years ago
- Build your feature store with macros right within your dbt repository☆37Updated last year
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆63Updated 6 months ago
- ☆32Updated 7 months ago
- Kedro Plugin to support running workflows on GCP Vertex AI Pipelines☆35Updated last month