databricks / unity-catalog-setup
Notebooks, terraform, tools to enable setting up Unity Catalog
☆44Updated last year
Related projects: ⓘ
- Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines☆142Updated this week
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆40Updated last month
- A Swiss-Army-knife for your Data Intelligence platform administration.☆104Updated last month
- An example showing how to apply software engineering best practices to Databricks notebooks.☆118Updated last month
- A Python Library to support running data quality rules while the spark job is running⚡☆161Updated last month
- Capture deep metrics on one or all assets within a Databricks workspace☆226Updated last week
- Automated migrations to Unity Catalog☆218Updated this week
- A dbt adapter for Databricks.☆211Updated this week
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆148Updated last month
- An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.☆46Updated 7 months ago
- Code samples, etc. for Databricks☆59Updated last month
- Set of Terraform automation templates and quickstart demos to jumpstart the design of a Lakehouse on Databricks. This project has incorpo…☆71Updated 7 months ago
- Old scripts for one-off ST-to-E2 migrations. Use "terraform exporter" linked in the readme.☆183Updated 9 months ago
- Best practices for working with Databricks from an IDE☆48Updated last year
- DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics f…☆38Updated 9 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆185Updated this week
- Examples of Databricks Asset Bundles☆81Updated last week
- A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT …☆46Updated last year
- Examples of using Terraform to deploy Databricks resources☆203Updated 2 weeks ago
- Databricks Implementation of the TPC-DI Specification using Traditional Notebooks and/or Delta Live Tables☆69Updated this week
- Extensible Rules Engine for custom Dataframe / Dataset validation☆134Updated 4 months ago
- Delta Lake helper methods in PySpark☆294Updated 2 weeks ago
- Databricks CLI☆129Updated this week
- Delta lake and filesystem helper methods☆48Updated 6 months ago
- Delta Lake examples☆201Updated 3 months ago
- Security Analysis Tool (SAT) analyzes customer's Databricks account and workspace security configurations and provides recommendations th…☆81Updated last week
- ☆16Updated last month
- Yet Another (Spark) ETL Framework☆18Updated 10 months ago
- Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used …☆309Updated last week
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 2 months ago