Alternatives and similar repositories for tsumugi-spark

Users that are interested in tsumugi-spark are comparing it to the libraries listed below

• SemyonSinchenko / feature-generation-benchmark
  A database-like benchmark of feature generation from time-series data
  ☆13Updated 8 months ago
• ayasyrev / nbmetaclean
  Cl app / pre-commit hook to clean Jupyter Notebooks metadata, execution_count and optionally output.
  ☆11Updated 5 months ago
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated last month
• Raiffeisen-DGTL / checkita-data-quality
  Fast data quality framework for modern data infrastructure
  ☆29Updated 6 months ago
• MobileTeleSystems / onetl
  One ETL tool to rule them all
  ☆80Updated 2 weeks ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆99Updated this week
• kaiko-ai / typedspark
  Column-wise type annotations for pyspark DataFrames
  ☆82Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated 2 weeks ago
• SemyonSinchenko / ibisgraph
  An implementation of Pregel framework and graph algorithms on top of it with Ibis project DataFrames.
  ☆23Updated 4 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated last week
• odnoklassniki / pravda-ml
  This project is used to capture machine learning pipelines created on top of Spark as OK
  ☆52Updated 2 years ago
• slgero / receipt_parser
  Allow parsing Russian receipts
  ☆53Updated 4 years ago
• amesar / mlflow-export-import
  Export and import MLflow experiments, runs or registered models
  ☆81Updated 3 years ago
• owenrh / spark-fires
  Spark fires is a anti-pattern playground where we deliberately break Spark applications in various ways so you can observe what happens a…
  ☆42Updated 8 months ago
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆71Updated 3 months ago
• DougTrajano / mlflow-server
  MLflow Tracking Server with basic auth deployed in AWS App Runner.
  ☆35Updated 2 years ago
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated last month
• transferwise / wise-pizza
  A library to find and visualise the most interesting slices in multidimensional data
  ☆109Updated 4 months ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆232Updated 6 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• delta-incubator / deltatorch
  ☆58Updated last year
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆709Updated last week
• getindata / kedro-kubeflow
  Kedro Plugin to support running workflows on Kubeflow Pipelines
  ☆54Updated last month
• ya-ds / crosspredict
  ☆25Updated last year
• getindata / kedro-azureml
  Kedro plugin to support running workflows on Microsoft Azure ML Pipelines
  ☆38Updated last week
• deordie / deordie-meetups
  DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
  ☆58Updated last year