Alternatives and similar repositories for pyspark-arrow-pandas

Users that are interested in pyspark-arrow-pandas are comparing it to the libraries listed below

• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• wesm / vldb-2019-apache-arrow-workshop
  Materials for Apache Arrow workshop at VLDB 2019
  ☆42Updated 4 years ago
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 6 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 9 months ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• Bergvca / pyspark_dist_explore
  Data Exploration in PySpark made easy - Pyspark_dist_explore provides methods to get fast insights in your Spark DataFrames.
  ☆103Updated 5 years ago
• mark-hoffmann / fastteradata
  Tools for faster and optimized interaction with Teradata and large datasets.
  ☆17Updated 6 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• sporveien / bricker
  CLI tool for syncing a Databricks folder structure with a local git repo.
  ☆17Updated 9 months ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 6 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated last month
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated last year
• rdblue / jupyter-zeppelin
  Conversion utility from Zeppelin notes to Jupyter notebooks.
  ☆44Updated 5 years ago
• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 7 years ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 3 years ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 7 years ago
• sat28 / zeppelin_notebook_to_script
  Converting a zeppelin notebook in single programming language to respective script
  ☆18Updated 5 years ago
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 2 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆230Updated 2 years ago
• cloudera / hs2client
  C++ native client for Impala and Hive, with Python / pandas bindings
  ☆72Updated 6 years ago
• rapidsai / spark-examples
  [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
  ☆70Updated 4 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 7 months ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 5 months ago
• dvgodoy / handyspark
  HandySpark - bringing pandas-like capabilities to Spark dataframes
  ☆193Updated 5 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• ShopRunner / stork
  Make your libraries magically appear in Databricks.
  ☆47Updated last year