Alternatives and similar repositories for pyspark-schema-generator:

Users that are interested in pyspark-schema-generator are comparing it to the libraries listed below

• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆51Updated 7 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆46Updated last year
• venkatra / dbt_hacks
  A bunch of hacks developed around dbt
  ☆48Updated 5 years ago
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆31Updated 2 years ago
• bgarcevic / danish-democracy-data
  ☆33Updated 3 weeks ago
• mrjsj / delta-lake-explorer
  ☆29Updated 8 months ago
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆23Updated last year
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 7 months ago
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆71Updated 2 months ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆31Updated last month
• ssp-data / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆54Updated last year
• kgmcquate / dbt-testgen
  Generate DBT tests based on sample data
  ☆36Updated last year
• nicor88 / dbt-serverless
  Run dbt serverless in the Cloud (AWS)
  ☆42Updated 5 years ago
• agile-lab-dev / Data-Product-Specification
  An open specification for data products in Data Mesh
  ☆55Updated 4 months ago
• mikekaminsky / dbt-setup-example
  A minimum viable setup for dbt with environment variables.
  ☆16Updated 6 years ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆78Updated last year
• danielbeach / DuckDBwithAWSLambda
  Using DuckDB with AWS Lambda to process Delta Lake data
  ☆23Updated 2 months ago
• victorcouste / data-tools
  Data Tools Subjective List
  ☆83Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 8 months ago
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 8 months ago
• StabRise / spark-pdf
  PDF DataSource for Apache Spark
  ☆44Updated last week
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆43Updated last week
• cnstlungu / portable-data-stack-sqlmesh
  A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset
  ☆49Updated 4 months ago
• danielbeach / DataEngineeringProjects
  Some example projects for Data Engineers to build, end-to-end.
  ☆28Updated last year
• memiiso / opendbt
  Make dbt great again! Enables end user to extend dbt to his/her needs
  ☆60Updated 3 weeks ago
• renardeinside / databricks-streamlit-demo
  Demo of Streamlit application with Databricks SQL Endpoint
  ☆36Updated 2 years ago
• ismaildawoodjee / GreatEx
  A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …
  ☆21Updated 2 years ago