rafaelleinio / thoth
Python tool for profiling-based anomaly monitoring on ETL data pipelines leveraging ML and Apache Spark.
☆16Updated last year
Alternatives and similar repositories for thoth:
Users that are interested in thoth are comparing it to the libraries listed below
- A tool for building feature stores.☆300Updated 2 weeks ago
- ☆21Updated 4 years ago
- Creates a Simulation of Fake Web Events☆84Updated 3 years ago
- Football scouts from Cartola FC at a data lake with data warehouse and dashboard☆17Updated 3 years ago
- ☆33Updated 3 years ago
- Airflow Deployment on AWS ECS Fargate Using Cloudformation☆204Updated 2 years ago
- A data engineering personal project for applying some of my skills☆19Updated 3 years ago
- Great Expectations Airflow operator☆163Updated this week
- Código para workshops Spark com ambiente de desenvolvimento em docker☆27Updated 3 years ago
- ☆43Updated 3 years ago
- ML made simple☆209Updated last year
- Demo DAGs that show how to run dbt Core in Airflow using Cosmos☆59Updated 6 months ago
- Collection of `pre-commit` hooks to ensure the quality of your `dbt` projects.☆47Updated 2 years ago
- Instalador autonomo do Apache Spark para Sistemas linux: based(Debian,RHEL)☆13Updated 4 months ago
- Data Engineering made simple - An opinionated Data Engineering framework☆65Updated last year
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Notebooks e dicas sobre Databricks☆20Updated 5 months ago
- Spyrk-cluster is a data mini-lab, considering the main technologies used these days. It's useful to either understand how to configure a …☆29Updated 4 years ago
- Desafio para Engenheiro(a) de Dados - VAGAS.com☆28Updated 5 years ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆147Updated this week
- ☆43Updated 3 years ago
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆244Updated 2 months ago
- A containerized Python framework for a better Data X development workflow. Where X = Science, Engineering, Analytics, etc.☆28Updated 3 years ago
- ☆46Updated 5 months ago
- ☆16Updated 2 years ago
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Updated 2 years ago
- This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of t…☆89Updated 3 years ago
- The athena adapter plugin for dbt (https://getdbt.com)☆140Updated 2 years ago
- Modern Data Stack☆62Updated 8 months ago
- ☆23Updated last year