Alternatives and similar repositories for typedspark:

Users that are interested in typedspark are comparing it to the libraries listed below

• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆208Updated 2 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆65Updated this week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆50Updated 11 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆168Updated last week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆192Updated this week
• benchsci / tinsel
  PySpark schema generator
  ☆41Updated last year
• tekumara / fakesnow
  Fake Snowflake Connector for Python. Run, mock and test Snowflake DB locally.
  ☆113Updated 3 weeks ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆180Updated this week
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆354Updated this week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆43Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated 4 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• souvik-databricks / dlt-with-debug
  A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT …
  ☆47Updated 2 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆315Updated 4 months ago
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆77Updated this week
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆249Updated last year
• duckdb / uc_catalog
  Proof-of-concept extension combining the delta extension with Unity Catalog
  ☆66Updated this week
• duckdb / duckdb-iceberg
  ☆200Updated last week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆385Updated last week
• kevinjqliu / iceberg-rest-catalog
  Pythonic Iceberg REST Catalog
  ☆72Updated 4 months ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆231Updated 6 months ago
• castor-team / airflow-castor
  ☆43Updated 3 years ago
• xdanny / pyspark_types
  Map your python dataclasses to pyspark types
  ☆9Updated 11 months ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆181Updated this week
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆657Updated 2 weeks ago
• gabledata / recap
  Work with your web service, database, and streaming schemas in a single format.
  ☆337Updated 10 months ago
• dataflint / spark
  Performance Observability for Apache Spark
  ☆216Updated this week
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆224Updated last month
• naushadh / hive-metastore
  Apache Hive Metastore as a Standalone server in Docker
  ☆68Updated 5 months ago
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆61Updated 2 years ago