Azure / config-driven-data-pipelineLinks
☆45Updated 9 months ago
Alternatives and similar repositories for config-driven-data-pipeline
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
Sorting:
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆187Updated last year
- Tools for Deploying Databricks Solutions in Azure☆98Updated last year
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆91Updated last year
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆110Updated last week
- dbt adapter for Azure Synapse Dedicated SQL Pools☆73Updated 2 weeks ago
- ☆95Updated 2 years ago
- ☆77Updated last year
- Complete end to end sample of doing DevOps with Azure Databricks☆69Updated 3 years ago
- How do to CI/CD with Azure Data Factory☆41Updated 4 years ago
- An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset☆109Updated 2 years ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆51Updated 3 weeks ago
- How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://…☆61Updated 9 months ago
- Azure SQL and Databricks samples and best practices for loading data quickly and efficiently☆34Updated 4 years ago
- Pytest plugin for writing Azure Data Factory Integration Tests☆25Updated 3 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆153Updated 11 months ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆21Updated 4 years ago
- ☆81Updated 2 years ago
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆20Updated this week
- An Azure Function which allows Azure Data Factory (ADF) to connect to Snowflake in a flexible way.☆26Updated 2 years ago
- Azure Databricks Workshops☆94Updated 5 years ago
- Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial☆72Updated 4 years ago
- FTA Toolkit - Analytics in a Box☆92Updated 6 months ago
- Deeper look into access control and data lake configuration☆34Updated 3 years ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆45Updated 6 months ago
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆30Updated 3 years ago
- This is a script that will read a Hive metastore and generate SQL Serverless create view statements.☆14Updated 5 years ago
- Azure Data Factory Data Flow Documentation☆201Updated 2 years ago
- Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former …☆38Updated 2 years ago
- Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs☆460Updated last year
- ☆11Updated 4 years ago