dask / dask-yarn

Related projects: ⓘ

• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆142Updated 6 months ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆130Updated this week
• swan-cern / jupyter-extensions
  Jupyter extensions for SWAN
  ☆58Updated this week
• dask / dask-docker
  Docker images for dask
  ☆231Updated this week
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated last year
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆193Updated 3 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆44Updated 2 years ago
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆312Updated this week
• dask / dask-xgboost
  ☆162Updated 3 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆84Updated 6 months ago
• jupyter / nb2kg
  ☆73Updated 4 years ago
• vericast / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated 8 months ago
• vericast / spylon-kernel
  Jupyter kernel for scala and spark
  ☆186Updated 8 months ago
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 3 years ago
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆134Updated last month
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 2 years ago
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆242Updated last month
• dask / dask-gateway
  A multi-tenant server for securely deploying and managing Dask clusters.
  ☆136Updated last month
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 6 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 5 years ago
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆45Updated 7 months ago
• coiled / dask-snowflake
  Dask integration for Snowflake
  ☆29Updated 2 months ago
• svenkreiss / pysparkling
  A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  ☆261Updated 2 weeks ago
• dask / dask-glm
  ☆75Updated 2 weeks ago
• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 6 years ago
• dask / helm-chart
  Helm charts for Dask
  ☆91Updated this week