moj-analytical-services / etl_manager
A python package to create a database on the platform using our moj data warehousing framework
☆21Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for etl_manager
- Fully unit tested utility functions for data engineering. Python 3 only.☆14Updated 2 months ago
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆26Updated 8 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated last year
- An experimental Athena extension for DuckDB 🐤☆50Updated 9 months ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆60Updated last year
- A serverless duckDB deployment at GCP☆35Updated 2 years ago
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆12Updated 11 months ago
- Fake Pandas / PySpark DataFrame creator☆42Updated 8 months ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 4 years ago
- ☆23Updated 5 years ago
- A python library bakeoff for medium sized datasets☆24Updated last year
- A containerized demo of Airflow using gusty☆39Updated 5 months ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆25Updated last year
- Build your feature store with macros right within your dbt repository☆37Updated last year
- A pyspark lib to validate data quality☆18Updated 2 years ago
- Utility functions for dbt projects running on Spark☆31Updated last year
- ☆19Updated 4 months ago
- A _simple_ starter template for Snowflake Cloud Data Platform☆39Updated 2 years ago
- The sane way of building a data layer in Airflow☆24Updated 4 years ago
- This repository contains files for the metrics framework playbook.☆36Updated 2 years ago
- Dask integration for Snowflake☆30Updated last week
- Ibis analytics, with Ibis (and more!)☆19Updated last month
- DuckDB SQL Tools add DuckDB support to VSCode, and provide database schema and SQL query interfaces for the popular SQLTools extension, S…☆12Updated 4 months ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Make dbt great again! Enables end user to extend dbt to his/her needs☆13Updated this week
- Docker image for dbt (data build tool).☆50Updated 2 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆36Updated 4 months ago