Alternatives and similar repositories for pyspark-internals:

Users that are interested in pyspark-internals are comparing it to the libraries listed below

• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆47Updated 4 years ago
• g1thubhub / phil_stopwatch
  ☆39Updated 6 years ago
• moyano83 / High-Performance-Spark
  ☆31Updated 5 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated 3 months ago
• findify / featury
  Friendly ML feature store
  ☆45Updated 2 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 7 months ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆61Updated 5 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 7 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• polyzos / stream-processing-with-apache-flink
  ☆53Updated 8 months ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 4 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆52Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last year
• AbsaOSS / spline-getting-started
  ☆24Updated 7 months ago
• maropu / datasketches-spark
  Data Sketches for Apache Spark
  ☆22Updated 2 years ago
• ververica / streaming-ledger
  Serializable ACID transactions on streaming data
  ☆24Updated 2 years ago
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 7 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆121Updated last month
• NVIDIA / spark-xgboost-examples
  XGBoost GPU accelerated on Spark example applications
  ☆52Updated 2 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago