Alternatives and similar repositories for data-ai-summit-2024

Users that are interested in data-ai-summit-2024 are comparing it to the libraries listed below

• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 4 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆230Updated last year
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆190Updated this week
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆323Updated last year
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆233Updated 9 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆75Updated 5 months ago
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆43Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆231Updated 3 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated last week
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆76Updated 4 years ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated 2 weeks ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated last week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆263Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 3 weeks ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆40Updated last year
• cloudera / dbt-spark-livy
  The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livy
  ☆12Updated 2 years ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆49Updated last year
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• PacktPublishing / Driving-Data-Quality-with-Data-Contracts
  ☆35Updated last month
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆248Updated last month
• bitsondatadev / trino-getting-started
  ☆269Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated last year
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆268Updated 2 weeks ago