Alternatives and similar repositories for pyspark-internals

Users that are interested in pyspark-internals are comparing it to the libraries listed below

• polyzos / stream-processing-with-apache-flink
  ☆58Updated 11 months ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆47Updated 4 years ago
• findify / featury
  Friendly ML feature store
  ☆45Updated 3 years ago
• moyano83 / High-Performance-Spark
  ☆31Updated 5 years ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 6 months ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆61Updated 7 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated 2 weeks ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆99Updated 2 years ago
• g1thubhub / phil_stopwatch
  ☆39Updated 6 years ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• ExpediaGroup / hiveberg
  Demonstration of a Hive Input Format for Iceberg
  ☆26Updated 4 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• cloudcheflabs / dataroaster
  ☆40Updated 2 years ago
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆64Updated last year
• airbnb / sputnik
  ☆63Updated 5 years ago
• trinodb / tempto
  A testing framework for Trino
  ☆26Updated 3 months ago
• AbsaOSS / spline-getting-started
  ☆25Updated 10 months ago
• skhatri / trino-by-example
  Presto Trino with Apache Hive Postgres metastore
  ☆42Updated 10 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆227Updated this week
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 6 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 9 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• maropu / datasketches-spark
  Data Sketches for Apache Spark
  ☆22Updated 2 years ago
• aljoscha / blog
  Thoughts on things I find interesting.
  ☆17Updated 6 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆75Updated this week
• ververica / streaming-ledger
  Serializable ACID transactions on streaming data
  ☆25Updated 2 years ago