Alternatives and similar repositories for airflow-provider-ray

Users that are interested in airflow-provider-ray are comparing it to the libraries listed below

• astronomer / ray-airflow-demo
  ☆31Updated 4 years ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆149Updated last year
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆41Updated 2 years ago
• ray-project / deltacat
  A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…
  ☆246Updated last week
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆322Updated last week
• flyteorg / flytesnacks
  Flyte Documentation 📖
  ☆83Updated 6 months ago
• flyteorg / flytekit
  Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
  ☆296Updated this week
• ploomber / soopervisor
  ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
  ☆45Updated 7 months ago
• project-codeflare / rayvens
  Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.
  ☆50Updated 2 years ago
• dask / dask-docker
  Docker images for dask
  ☆243Updated last week
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆138Updated last month
• PrefectHQ / server
  The Prefect API and backend
  ☆246Updated 2 years ago
• anna-geller / prefect-deployment-patterns
  Code examples showing flow deployment to various types of infrastructure
  ☆110Updated 2 years ago
• oap-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆348Updated 3 months ago
• SeldonIO / tempo
  MLOps Python Library
  ☆120Updated 3 years ago
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆145Updated last week
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆408Updated last year
• logicalclocks / maggy
  Distribution transparent Machine Learning experiments on Apache Spark
  ☆91Updated last year
• bytehub-ai / bytehub
  ByteHub: making feature stores simple
  ☆61Updated 4 years ago
• ucbrise / flor
  FlorDB 🌻
  ☆153Updated last week
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated last year
• PrefectHQ / prefect-ray
  Prefect integrations with Ray
  ☆63Updated last year
• modin-project / unidist
  Unified Distributed Execution
  ☆56Updated last year
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 5 years ago
• apache / incubator-liminal
  Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …
  ☆145Updated last year
• tamsanh / kedro-great
  The easiest way to integrate Kedro and Great Expectations
  ☆54Updated 2 years ago
• godatadriven / pydantic-avro
  This library can convert a pydantic class to a avro schema or generate python code from a avro schema.
  ☆79Updated last week
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆146Updated last year
• iterative / gto
  🏷️ Git Tag Ops. Turn your Git repository into Artifact Registry or Model Registry.
  ☆153Updated this week