Azure / config-driven-data-pipelineLinks
☆46Updated 11 months ago
Alternatives and similar repositories for config-driven-data-pipeline
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
Sorting:
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆187Updated last year
- dbt adapter for Azure Synapse Dedicated SQL Pools☆75Updated 3 weeks ago
- An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset☆110Updated 2 years ago
- Complete end to end sample of doing DevOps with Azure Databricks☆70Updated 3 years ago
- ☆95Updated 3 years ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆21Updated 4 years ago
- ☆77Updated last year
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆92Updated last year
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆112Updated last month
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆31Updated 4 years ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆51Updated last month
- Deeper look into access control and data lake configuration☆34Updated 3 years ago
- How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://…☆61Updated 11 months ago
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆20Updated 2 weeks ago
- How do to CI/CD with Azure Data Factory☆41Updated 4 years ago
- Azure Data Factory Data Flow Documentation☆201Updated 2 years ago
- FTA Toolkit - Analytics in a Box☆92Updated 8 months ago
- Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial☆73Updated 4 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆153Updated last year
- Tools for Deploying Databricks Solutions in Azure☆98Updated last year
- devops-for-databricks☆63Updated last year
- Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Sc…☆80Updated 2 years ago
- Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former …☆38Updated 2 years ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆46Updated 7 months ago
- ☆52Updated last year
- Azure Synapse Spark Metrics provides easy metrics monitoring functions for Synapse services, especially, Apache Spark pool instances, by …☆22Updated 2 years ago
- Azure SQL and Databricks samples and best practices for loading data quickly and efficiently☆34Updated 4 years ago
- An Azure Function which allows Azure Data Factory (ADF) to connect to Snowflake in a flexible way.☆26Updated 2 years ago
- Azure Databricks Workshops☆94Updated 5 years ago
- Pytest plugin for writing Azure Data Factory Integration Tests☆25Updated 3 years ago