procter-gamble-oss / octopufsLinks
OctopuFS library helps managing cloud storage, ADLSgen2 specifically. It allows you to operate on files (moving, copying, setting ACLs) in very efficient manner. Designed to work on databricks, but should work on any other platform as well.
☆11Updated last year
Alternatives and similar repositories for octopufs
Users that are interested in octopufs are comparing it to the libraries listed below
Sorting:
- ☆76Updated last year
- A python package to help work with the apache atlas REST APIs☆176Updated 8 months ago
- Monitoring Azure Databricks jobs☆229Updated 8 months ago
- Databricks Platform - Architecture, Security, Automation and much more!!☆51Updated 2 months ago
- Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs☆237Updated 4 months ago
- ☆94Updated 2 years ago
- A connector to ingest Azure Databricks lineage into Microsoft Purview☆92Updated last year
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆45Updated 5 months ago
- Testing framework for Databricks notebooks☆303Updated last year
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆152Updated 10 months ago
- A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration…☆186Updated last year
- Apache Spark Connector for Azure Cosmos DB☆204Updated 3 months ago
- Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs☆459Updated last year
- Connect your Spark Databricks clusters Log4J output to the Application Insights Appender☆19Updated 4 years ago
- Apache Spark Connector for SQL Server and Azure SQL☆286Updated 4 months ago
- Tools for Deploying Databricks Solutions in Azure☆99Updated last year
- PowerShell wrapper for the Databricks API☆43Updated 2 weeks ago
- DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!☆64Updated 2 months ago
- Complete end to end sample of doing DevOps with Azure Databricks☆70Updated 3 years ago
- A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure…☆108Updated last month
- A proof of concept of how to integrate Spark Lineage in Azure Purview☆22Updated 4 years ago
- ☆52Updated last year
- Deeper look into access control and data lake configuration☆34Updated 3 years ago
- DrawIO Library for Databricks Icons☆35Updated last year
- Azure Databricks Workshops☆94Updated 4 years ago
- End-to-end Azure Databricks Workspace automation with Azure Pipelines☆22Updated last year
- Examples surrounding Databricks.☆59Updated 11 months ago
- How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://…☆60Updated 8 months ago
- This project provides a client library that allows Azure SQL DB or SQL Server to act as an input source or output sink for Spark jobs.☆77Updated 4 years ago
- Solution accelerator to help build Machine Learning Lineage☆33Updated 2 years ago