Azure / config-driven-data-pipeline
☆44Updated 6 months ago
Alternatives and similar repositories for config-driven-data-pipeline:
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
- ☆76Updated 10 months ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆51Updated 2 weeks ago
- dbt adapter for Azure Synapse Dedicated SQL Pools☆71Updated 2 weeks ago
- How do to CI/CD with Azure Data Factory☆41Updated 4 years ago
- ☆95Updated 2 years ago
- Deeper look into access control and data lake configuration☆34Updated 3 years ago
- FTA Toolkit - Analytics in a Box☆91Updated 3 months ago
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆185Updated last year
- An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset☆108Updated 2 years ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆22Updated 4 years ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆45Updated 3 months ago
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆93Updated last year
- Complete end to end sample of doing DevOps with Azure Databricks☆69Updated 3 years ago
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆103Updated last week
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆30Updated 3 years ago
- ☆102Updated last week
- Template to deploy Synapse Analytics using best practices to deliver a proof of concept.☆22Updated 2 years ago
- How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://…☆60Updated 6 months ago
- Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Sc…☆80Updated last year
- ☆22Updated 3 years ago
- devops-for-databricks☆61Updated 10 months ago
- This is a script that will read a Hive metastore and generate SQL Serverless create view statements.☆14Updated 4 years ago
- Readiness content packs for Azure Synapse Analytics features released at GA.☆40Updated 4 years ago
- SQL scripts for Azure Synapse Analytics Serverless SQL Pools☆28Updated 2 years ago
- Extract Load Transform (ELT) framework is a metadata based batch orchestration framework for modern data platforms. Implemented using Azu…☆33Updated 3 months ago
- Azure Deployments using Terraform☆30Updated 2 years ago
- ☆81Updated 2 years ago
- Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )☆86Updated 6 years ago
- ☆24Updated 4 years ago
- Microsoft Purview CLI☆46Updated 2 months ago