Alternatives and similar repositories for hadoop-test-cluster:

Users that are interested in hadoop-test-cluster are comparing it to the libraries listed below

• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 6 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• wesm / dataframe-protocol
  An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary
  ☆15Updated 5 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 8 months ago
• EamonKeane / airflow-GKE-k8sExecutor-helm
  Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…
  ☆36Updated 4 years ago
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 6 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 4 months ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• facultyai / marshmallow-dataframe
  Marshmallow Schema generator for Pandas DataFrames
  ☆24Updated 4 years ago
• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 6 years ago
• Flowminder / pytest-airflow
  pytest support for airflow
  ☆12Updated 4 years ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 7 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated 2 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• dask / dask-gke
  kubernetes setup to bootstrap distributed on google container engine
  ☆67Updated 5 years ago
• geosolutions-it / evo-odas
  Code Repository for the EVO-ODAS
  ☆31Updated 7 years ago
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• coiled / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 5 months ago
• exasol / sqlalchemy-exasol
  SQLAlchemy dialect for EXASOL
  ☆35Updated last week
• jupyterhub / jupyterhub-example-kerberos
  Example for experimenting with how JupyterHub can be configured to work with Kerberos
  ☆33Updated 7 years ago
• spark-jobserver / python-sjsclient
  Python client for Spark Jobserver Rest API
  ☆39Updated 5 years ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated 2 years ago
• paypal / PPExtensions
  Set of iPython and Jupyter extensions to improve user experience
  ☆50Updated 5 years ago
• jcrist / venv-pack
  Package virtual environments for redistribution
  ☆45Updated 2 years ago
• tcarette / vim-sparkShell
  control spark-shell from vim
  ☆11Updated 8 years ago