Alternatives and similar repositories for typedspark

Users that are interested in typedspark are comparing it to the libraries listed below

• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated last week
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆118Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆194Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆223Updated last month
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆427Updated 8 months ago
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆261Updated 2 years ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆326Updated last week
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago
• tekumara / fakesnow
  Run, mock and test fake Snowflake databases locally.
  ☆163Updated 3 weeks ago
• AbsaOSS / pramen
  Resilient data pipeline framework running on Apache Spark
  ☆25Updated this week
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆395Updated last week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆272Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated last year
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated 2 weeks ago
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆477Updated this week
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 3 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated last year
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 7 months ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆169Updated 4 months ago
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆253Updated last week
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆49Updated last month
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆240Updated 7 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆96Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆81Updated 9 months ago
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆178Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 9 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆46Updated 6 months ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago