Alternatives and similar repositories for airflow-provider-ray

Users that are interested in airflow-provider-ray are comparing it to the libraries listed below

• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆149Updated last year
• astronomer / ray-airflow-demo
  ☆30Updated 4 years ago
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆41Updated 2 years ago
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆242Updated this week
• flyteorg / flytekit
  Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
  ☆292Updated this week
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆322Updated 2 months ago
• ploomber / soopervisor
  ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
  ☆45Updated 6 months ago
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆138Updated last month
• flyteorg / flytesnacks
  Flyte Documentation 📖
  ☆83Updated 6 months ago
• flyteorg / flytelab
  Machine Learning Projects with Flytekit
  ☆37Updated 2 years ago
• project-codeflare / rayvens
  Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.
  ☆50Updated 2 years ago
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆145Updated this week
• getindata / kedro-kubeflow
  Kedro Plugin to support running workflows on Kubeflow Pipelines
  ☆55Updated 3 months ago
• modin-project / unidist
  Unified Distributed Execution
  ☆56Updated 11 months ago
• fsspec / gcsfs
  Pythonic file-system interface for Google Cloud Storage
  ☆374Updated 2 weeks ago
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆77Updated 3 years ago
• SeldonIO / tempo
  MLOps Python Library
  ☆119Updated 3 years ago
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆407Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆58Updated 2 years ago
• ucbrise / flor
  Flow with FlorDB 🌻
  ☆153Updated last week
• MagnivOrg / magniv-core
  Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.
  ☆80Updated last year
• oap-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆347Updated 2 months ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated last year
• bytehub-ai / bytehub
  ByteHub: making feature stores simple
  ☆61Updated 4 years ago
• anna-geller / prefect-deployment-patterns
  Code examples showing flow deployment to various types of infrastructure
  ☆109Updated 2 years ago
• davidmirror-ops / flyte-the-hard-way
  Prepare requirements and deploy Flyte using Helm
  ☆79Updated 5 months ago
• mlspec / MLSpec
  Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…
  ☆94Updated last year
• dask / dask-docker
  Docker images for dask
  ☆242Updated 2 weeks ago
• godatadriven / pydantic-avro
  This library can convert a pydantic class to a avro schema or generate python code from a avro schema.
  ☆78Updated 2 weeks ago
• unionai-oss / unionml
  UnionML: the easiest way to build and deploy machine learning microservices
  ☆336Updated last year