Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
☆228Feb 11, 2026Updated 3 weeks ago
Alternatives and similar repositories for brickflow
Users that are interested in brickflow are comparing it to the libraries listed below
Sorting:
- A Python Library to support running data quality rules while the spark job is running⚡☆200Updated this week
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆45Jan 24, 2026Updated last month
- Delta Lake helper methods in PySpark☆327Jan 19, 2026Updated last month
- PySpark test helper methods with beautiful error messages☆753Feb 25, 2026Updated last week
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆282Oct 7, 2025Updated 4 months ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆683Mar 6, 2025Updated 11 months ago
- Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipeli…☆652Updated this week
- Testing framework for Databricks notebooks☆316Apr 20, 2024Updated last year
- ✨ A Pydantic to PySpark schema library☆121Updated this week
- ☆18Aug 6, 2024Updated last year
- csv and flat-file sniffer built in Rust.☆45Jan 26, 2024Updated 2 years ago
- Open, Multi-modal Catalog for Data & AI☆3,320Updated this week
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Mar 25, 2024Updated last year
- Delta reader for the Ray open-source toolkit for building ML applications☆45Jan 27, 2024Updated 2 years ago
- Custom PySpark Connectors☆89Updated this week
- A web application for creating and managing Databricks cluster policies with an interactive UI, allowing users to configure policy attrib…☆17May 7, 2025Updated 9 months ago
- Delta lake and filesystem helper methods☆50Feb 29, 2024Updated 2 years ago
- Spark style guide☆272Sep 30, 2024Updated last year
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Sep 7, 2023Updated 2 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆151Aug 14, 2024Updated last year
- A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran☆22Feb 24, 2026Updated last week
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆46Jan 27, 2025Updated last year
- A python SPark ETL libRary (SPETLR) for Databricks. https://discord.gg/p9bzqGybVW☆24Feb 13, 2026Updated 2 weeks ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Jun 12, 2024Updated last year
- 🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks☆57Jul 4, 2025Updated 8 months ago
- A collection of post-quantum cryptographic algorithms (and emerging standards) implemented in Rust.☆16Jul 18, 2025Updated 7 months ago
- An implementation of faster-rcnn for people detection in python☆10Apr 30, 2019Updated 6 years ago
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Jul 31, 2023Updated 2 years ago
- A downloadable pdf containing summary of frequently used pandas operations.☆10Sep 26, 2020Updated 5 years ago
- Rust course☆10May 24, 2025Updated 9 months ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated 8 months ago
- Template for a data contract used in a data mesh.☆486Mar 13, 2024Updated last year
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- Incan: a modern, Pythonic language that compiles to Rust! Type-safe, async-friendly, with fixtures, testing, and web/inter-op built in.☆12Feb 23, 2026Updated last week
- Quantum Machine Learning☆10Jan 19, 2023Updated 3 years ago
- ☆10Mar 8, 2022Updated 3 years ago
- Furnace is a high-performance quantitative trading library that provides features similar to CCXT, allowing developers to connect and int…☆14Jan 16, 2025Updated last year
- ☆11Mar 24, 2021Updated 4 years ago
- This is a repository for the LinkedIn Learning course Fine-tuning LLMs for Cybersecurity: Mistral, LLaMa, AutoTrain, AutoGen☆17Oct 30, 2024Updated last year