Alternatives and similar repositories for tsumugi-spark:

Users that are interested in tsumugi-spark are comparing it to the libraries listed below

• MobileTeleSystems / onetl
  One ETL tool to rule them all
  ☆71Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆26Updated last month
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆69Updated last week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆173Updated last week
• odnoklassniki / pravda-ml
  This project is used to capture machine learning pipelines created on top of Spark as OK
  ☆52Updated 2 years ago
• kaiko-ai / typedspark
  Column-wise type annotations for pyspark DataFrames
  ☆71Updated this week
• SemyonSinchenko / feature-generation-benchmark
  A database-like benchmark of feature generation from time-series data
  ☆14Updated 3 months ago
• ayasyrev / nbmetaclean
  Cl app / pre-commit hook to clean Jupyter Notebooks metadata, execution_count and optionally output.
  ☆11Updated this week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated 11 months ago
• dacort / faker-cli
  Command-line interface to quickly generate fake CSV and JSON data
  ☆72Updated 7 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 5 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆201Updated this week
• Gorini4 / jupyter_scala_docker
  Docker Compose with Almond.sh core for Jupyter
  ☆17Updated 5 months ago
• delta-incubator / deltatorch
  ☆55Updated last year
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆182Updated this week
• Raiffeisen-DGTL / checkita-data-quality
  Fast data quality framework for modern data infrastructure
  ☆26Updated 3 weeks ago
• Toloka / dbt-af
  Distributed run of dbt models using Airflow
  ☆144Updated this week
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆40Updated last month
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 7 months ago
• bartosz25 / data-ai-summit-2024
  Visits sessionization pipeline used for the talk
  ☆13Updated 8 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆319Updated 5 months ago
• analysiscenter / nbtools
  Utilities for monitoring and interacting with Jupyter Notebooks
  ☆38Updated 7 months ago
• getindata / kedro-kubeflow
  Kedro Plugin to support running workflows on Kubeflow Pipelines
  ☆53Updated 5 months ago
• deordie / deordie-meetups
  DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
  ☆57Updated last year
• StabRise / spark-pdf
  PDF DataSource for Apache Spark
  ☆41Updated this week
• ttzt / catalog_of_requirements_for_ai_products
  The purpose of the catalog is to help data science teams to collect all the requirements to consider while building a ML model and produc…
  ☆128Updated 4 years ago
• Snowflake-Labs / mlflow-snowflake
  ☆34Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆72Updated 3 weeks ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆23Updated 8 months ago