Alternatives and similar repositories for airflow-provider-ray

Users that are interested in airflow-provider-ray are comparing it to the libraries listed below

• astronomer / ray-airflow-demo
  ☆31Updated 4 years ago
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆42Updated 2 years ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• ray-project / deltacat
  A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…
  ☆267Updated 2 weeks ago
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆324Updated 3 weeks ago
• cylondata / cylon
  Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
  ☆301Updated this week
• ploomber / soopervisor
  ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
  ☆45Updated 10 months ago
• flyteorg / flytesnacks
  Flyte Documentation 📖
  ☆86Updated 10 months ago
• dask / dask-docker
  Docker images for dask
  ☆244Updated this week
• ray-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆360Updated this week
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆145Updated 3 months ago
• MagnivOrg / magniv-core
  Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.
  ☆81Updated last year
• flyteorg / flytekit
  Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
  ☆305Updated this week
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆137Updated 5 months ago
• SeldonIO / tempo
  MLOps Python Library
  ☆121Updated 3 years ago
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆409Updated last year
• project-codeflare / rayvens
  Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.
  ☆50Updated 3 years ago
• apache / incubator-liminal
  Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …
  ☆144Updated last year
• IBM / jupyterlab-s3-browser
  A JupyterLab extension for browsing S3-compatible object storage
  ☆132Updated 4 months ago
• ray-project / plasma
  A minimal shared memory object store design
  ☆59Updated 9 years ago
• ucbrise / flor
  FlorDB 🌻
  ☆158Updated 3 months ago
• godatadriven / pydantic-avro
  This library can convert a pydantic class to a avro schema or generate python code from a avro schema.
  ☆82Updated last week
• Netflix / metaflow-service
  Metadata tracking and UI service for Metaflow!
  ☆218Updated last month
• dask / dask-gateway
  A multi-tenant server for securely deploying and managing Dask clusters.
  ☆143Updated 3 weeks ago
• bytehub-ai / bytehub
  ByteHub: making feature stores simple
  ☆61Updated 4 years ago
• rapidsai / gpu-bdb
  RAPIDS GPU-BDB
  ☆108Updated last year
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆232Updated 2 years ago
• fsspec / gcsfs
  Pythonic file-system interface for Google Cloud Storage
  ☆381Updated this week
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆56Updated last week
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago