Alternatives and similar repositories for spark-udf

Users that are interested in spark-udf are comparing it to the libraries listed below

• Bergvca / pyspark_dist_explore
  Data Exploration in PySpark made easy - Pyspark_dist_explore provides methods to get fast insights in your Spark DataFrames.
  ☆103Updated 5 years ago
• adtech-labs / spylon-kernel
  Jupyter kernel for scala and spark
  ☆189Updated last year
• amesar / spark-python-scala-udf
  Demonstrates calling a Scala UDF from Python using spark-submit with an EGG and JAR
  ☆22Updated 5 years ago
• dvgodoy / handyspark
  HandySpark - bringing pandas-like capabilities to Spark dataframes
  ☆196Updated 6 years ago
• rapidsai / spark-examples
  [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
  ☆70Updated 5 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated 2 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last month
• jkthompson / pyspark-pictures
  Learn the pyspark API through pictures and simple examples
  ☆170Updated 4 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated 2 years ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated last month
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆249Updated 3 months ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 4 years ago
• geosolutions-it / evo-odas
  Code Repository for the EVO-ODAS
  ☆32Updated 7 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• hhbyyh / DataFrameCheatSheet
  Cheatsheet for Spark DataFrame
  ☆91Updated 5 years ago
• logicalclocks / hops-examples
  Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops
  ☆118Updated 2 years ago
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• GoogleCloudDataproc / cloud-dataproc
  Cloud Dataproc: Samples and Utils
  ☆203Updated last month
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆16Updated 7 years ago
• Affirm / shparkley
  Spark implementation of computing Shapley Values using monte-carlo approximation
  ☆74Updated 2 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 3 weeks ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆100Updated 4 years ago