Alternatives and similar repositories for airflow-provider-ray

Users that are interested in airflow-provider-ray are comparing it to the libraries listed below

• astronomer / ray-airflow-demo
  ☆30Updated 3 years ago
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆42Updated last year
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆222Updated this week
• ploomber / soopervisor
  ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
  ☆45Updated 3 months ago
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆323Updated last week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆45Updated 3 years ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆148Updated 11 months ago
• flyteorg / flytesnacks
  Flyte Documentation 📖
  ☆82Updated 2 months ago
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆143Updated this week
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 2 years ago
• flyteorg / flytelab
  Machine Learning Projects with Flytekit
  ☆36Updated 2 years ago
• dask / dask-gateway
  A multi-tenant server for securely deploying and managing Dask clusters.
  ☆141Updated 3 weeks ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆76Updated 3 years ago
• dask / dask-docker
  Docker images for dask
  ☆241Updated last month
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 6 months ago
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆137Updated 10 months ago
• MagnivOrg / magniv-core
  Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.
  ☆79Updated 11 months ago
• apache / incubator-liminal
  Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …
  ☆143Updated 11 months ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆56Updated 2 years ago
• pola-rs / dask-polars
  Coming soon
  ☆61Updated last year
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated last week
• PrefectHQ / prefect-ray
  Prefect integrations with Ray
  ☆63Updated last year
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 10 months ago
• rapidsai / gpu-bdb
  RAPIDS GPU-BDB
  ☆108Updated last year
• cylondata / cylon
  Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
  ☆301Updated last year
• modin-project / unidist
  Unified Distributed Execution
  ☆53Updated 8 months ago
• PrefectHQ / server
  The Prefect API and backend
  ☆241Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• dask / helm-chart
  Helm charts for Dask
  ☆96Updated this week