Azure / config-driven-data-pipeline
☆43Updated 5 months ago
Alternatives and similar repositories for config-driven-data-pipeline:
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
- ☆76Updated 9 months ago
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆185Updated last year
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆92Updated 11 months ago
- ☆94Updated 2 years ago
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆18Updated 2 weeks ago
- dbt adapter for Azure Synapse Dedicated SQL Pools☆70Updated 4 months ago
- devops-for-databricks☆60Updated 9 months ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆50Updated last week
- Complete end to end sample of doing DevOps with Azure Databricks☆69Updated 3 years ago
- Deeper look into access control and data lake configuration☆34Updated 2 years ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆22Updated 4 years ago
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆95Updated last month
- FTA Toolkit - Analytics in a Box☆87Updated 2 months ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆150Updated 7 months ago
- ☆52Updated last year
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆44Updated last month
- ☆81Updated 2 years ago
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆30Updated 3 years ago
- Extract Load Transform (ELT) framework is a metadata based batch orchestration framework for modern data platforms. Implemented using Azu…☆32Updated last month
- An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset☆108Updated last year
- How do to CI/CD with Azure Data Factory☆40Updated 4 years ago
- Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Sc…☆77Updated last year
- Lab environment deployments for the Microsoft data engineering (DP-203) ILT learning content.☆27Updated 3 years ago
- Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial☆69Updated 3 years ago
- ☆93Updated this week
- https://aka.ms/lakehouselab☆23Updated 2 years ago
- ☆16Updated 4 years ago
- Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former …☆38Updated last year
- Azure Databricks Workshops☆91Updated 4 years ago
- ☆87Updated last year