Azure / config-driven-data-pipeline
☆43Updated 4 months ago
Alternatives and similar repositories for config-driven-data-pipeline:
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆185Updated last year
- ☆76Updated 8 months ago
- ☆93Updated 2 years ago
- Complete end to end sample of doing DevOps with Azure Databricks☆69Updated 3 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆150Updated 6 months ago
- How do to CI/CD with Azure Data Factory☆40Updated 4 years ago
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆94Updated 2 weeks ago
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆92Updated 10 months ago
- Deeper look into access control and data lake configuration☆34Updated 2 years ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆50Updated this week
- Extract Load Transform (ELT) framework is a metadata based batch orchestration framework for modern data platforms. Implemented using Azu…☆31Updated 2 weeks ago
- dbt adapter for Azure Synapse Dedicated SQL Pools☆70Updated 3 months ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆44Updated 2 weeks ago
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆30Updated 3 years ago
- Connect your Spark Databricks clusters Log4J output to the Application Insights Appender☆19Updated 4 years ago
- Tools for Deploying Databricks Solutions in Azure☆99Updated last year
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆16Updated this week
- A python package to help work with the apache atlas REST APIs☆172Updated 3 months ago
- An Azure Function which allows Azure Data Factory (ADF) to connect to Snowflake in a flexible way.☆26Updated last year
- ☆52Updated last year
- ☆16Updated 4 years ago
- Template to deploy Synapse Analytics using best practices to deliver a proof of concept.☆22Updated last year
- Pytest plugin for writing Azure Data Factory Integration Tests☆25Updated 3 years ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆22Updated 3 years ago
- Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )☆84Updated 6 years ago
- ☆22Updated 3 years ago
- Azure SQL and Databricks samples and best practices for loading data quickly and efficiently☆33Updated 4 years ago
- Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Sc…☆77Updated last year
- devops-for-databricks☆60Updated 7 months ago
- FTA Toolkit - Analytics in a Box☆84Updated last month