TristanBilot / bqfetchLinks
A lightweight tool to fetch tables from BigQuery as pandas DataFrame very fast using BigQuery Storage API combined with multiprocessing
☆27Updated 2 years ago
Alternatives and similar repositories for bqfetch
Users that are interested in bqfetch are comparing it to the libraries listed below
Sorting:
- Templates for your Kedro projects.☆77Updated this week
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated last year
- ☆55Updated last week
- Cost Efficient Data Pipelines with DuckDB☆55Updated 2 months ago
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆34Updated 2 months ago
- Build your feature store with macros right within your dbt repository☆39Updated 2 years ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated last year
- Sample projects using Ploomber.☆86Updated last year
- The easiest way to integrate Kedro and Great Expectations☆52Updated 2 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆86Updated 2 years ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆8Updated last week
- Package for dbt that allows users to train, audit and use BigQuery ML models.☆73Updated 2 weeks ago
- An LLM-powered chatbot with the added context of the dbt knowledge base.☆39Updated 7 months ago
- Linear regression in SQL using dbt☆71Updated 6 months ago
- Code examples showing flow deployment to various types of infrastructure☆107Updated 2 years ago
- Make simple storing test results and visualisation of these in a BI dashboard☆45Updated 2 weeks ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated last week
- The shared semantic layer definitions that dbt-core and MetricFlow use.☆80Updated last week
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆54Updated 2 weeks ago
- Contribute to dlt verified sources 🔥☆87Updated 3 weeks ago
- Experimental MLflow plugin for Google Cloud Vertex AI☆38Updated last month
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆30Updated 4 years ago
- Helper code to interact with Rasgo via our SDK, PyRasgo☆40Updated 2 years ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆195Updated this week
- Playground for using large language models into the Modern Data Stack for entity matching☆108Updated 2 years ago
- Find data quality issues and clean your data in a single line of code with a Scikit-Learn compatible Transformer.☆131Updated last year
- ☆46Updated 11 months ago
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago