Alternatives and similar repositories for pyspark-internals

Users that are interested in pyspark-internals are comparing it to the libraries listed below

• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆186Updated 10 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated last week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆45Updated 5 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• airbnb / sputnik
  ☆63Updated 6 years ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆63Updated last week
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 10 months ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆102Updated 2 years ago
• moyano83 / High-Performance-Spark
  ☆31Updated 6 years ago
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆223Updated 2 years ago
• polyzos / stream-processing-with-apache-flink
  ☆62Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆122Updated last week
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated last year
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• findify / featury
  Friendly ML feature store
  ☆45Updated 3 years ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆130Updated last week
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆587Updated last year
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆199Updated last week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated last month
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 6 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated last month
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆184Updated last month
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated this week
• trinodb / trino-the-definitive-guide
  Resource for the book Trino: The Definitive Guide (and formerly Presto: The Definitive Guide)
  ☆229Updated 3 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆233Updated 9 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆191Updated this week