spetlr-org / spetlrLinks
A python SPark ETL libRary (SPETLR) for Databricks. https://discord.gg/p9bzqGybVW
☆20Updated this week
Alternatives and similar repositories for spetlr
Users that are interested in spetlr are comparing it to the libraries listed below
Sorting:
- ☆30Updated 11 months ago
- Streaming demo dbt☆17Updated 8 months ago
- Code samples, etc. for Databricks☆64Updated this week
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆152Updated 9 months ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆45Updated 4 months ago
- Spark app to merge different schemas☆23Updated 4 years ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆27Updated 4 months ago
- ☆40Updated 3 years ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆43Updated 10 months ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 11 months ago
- This repo contains live examples to build Databricks' Lakehouse and recommended best practices from the field.☆20Updated 7 months ago
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆67Updated last month
- Tools for Microsoft Fabric☆18Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Delta lake and filesystem helper methods☆51Updated last year
- Examples surrounding Databricks.☆58Updated 11 months ago
- Databricks CI/CD using Azure DevOps☆20Updated 2 years ago
- Delta Lake examples☆225Updated 7 months ago
- Custom PySpark Data Sources☆53Updated last month
- Example of a scalable IoT data processing pipeline setup using Databricks☆32Updated 4 years ago
- Visits sessionization pipeline used for the talk☆13Updated last year
- PySpark schema generator☆42Updated 2 years ago
- ☆18Updated 9 months ago
- Git Repo for EDW Best Practice Assets on the Lakehouse☆15Updated last year
- Delta Lake helper methods. No Spark dependency.☆23Updated 8 months ago
- ☆12Updated 3 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated this week
- build dw with dbt☆45Updated 7 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆52Updated 6 months ago