Azure / config-driven-data-pipelineLinks
☆45Updated 10 months ago
Alternatives and similar repositories for config-driven-data-pipeline
Users that are interested in config-driven-data-pipeline are comparing it to the libraries listed below
Sorting:
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆187Updated last year
- ☆77Updated last year
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆111Updated 3 weeks ago
- Complete end to end sample of doing DevOps with Azure Databricks☆69Updated 3 years ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆51Updated last week
- ☆95Updated 3 years ago
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆21Updated 4 years ago
- An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset☆109Updated 2 years ago
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆92Updated last year
- FTA Toolkit - Analytics in a Box☆92Updated 7 months ago
- Azure Databricks Workshops☆94Updated 5 years ago
- Azure SQL and Databricks samples and best practices for loading data quickly and efficiently☆34Updated 4 years ago
- How do to CI/CD with Azure Data Factory☆41Updated 4 years ago
- dbt adapter for Azure Synapse Dedicated SQL Pools☆74Updated last week
- A python package to help work with the apache atlas REST APIs☆177Updated 10 months ago
- How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://…☆61Updated 10 months ago
- Tools for Deploying Databricks Solutions in Azure☆98Updated last year
- Deeper look into access control and data lake configuration☆34Updated 3 years ago
- Azure Data Factory Data Flow Documentation☆201Updated 2 years ago
- ☆81Updated 2 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆153Updated last year
- Fast and Easy to convert Mapping data flows from Azure Data Factory to Microsoft Fabric Notebook and Spark Job.☆24Updated last year
- Extract Load Transform (ELT) framework is a metadata based batch orchestration framework for modern data platforms. Implemented using Azu…☆37Updated 3 weeks ago
- ☆22Updated 3 years ago
- ☆11Updated 4 years ago
- ☆33Updated last month
- A cloud data platform product to accelerate time to insights. Our open-source framework is designed for the real world. Stripping away th…☆20Updated this week
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆31Updated 4 years ago
- Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial☆73Updated 4 years ago
- Connect your Spark Databricks clusters Log4J output to the Application Insights Appender☆19Updated 5 years ago