anyscale / airflow-provider-rayLinks
Ray provider for Apache Airflow
☆48Updated last year
Alternatives and similar repositories for airflow-provider-ray
Users that are interested in airflow-provider-ray are comparing it to the libraries listed below
Sorting:
- ☆31Updated 4 years ago
- Distributed XGBoost on Ray☆149Updated last year
- Ray-based Apache Beam runner☆41Updated 2 years ago
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆246Updated last week
- Native Kubernetes integration for Dask☆322Updated last week
- Flyte Documentation 📖☆83Updated 6 months ago
- Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.☆296Updated this week
- ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.☆45Updated 7 months ago
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Updated 2 years ago
- Docker images for dask☆243Updated last week
- Apache Avro <-> pandas DataFrame☆138Updated last month
- The Prefect API and backend☆246Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆110Updated 2 years ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆348Updated 3 months ago
- MLOps Python Library☆120Updated 3 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated last week
- Distributed SQL Engine in Python using Dask☆408Updated last year
- Distribution transparent Machine Learning experiments on Apache Spark☆91Updated last year
- ByteHub: making feature stores simple☆61Updated 4 years ago
- FlorDB 🌻☆153Updated last week
- Deploy dask on YARN clusters☆69Updated last year
- Prefect integrations with Ray☆63Updated last year
- Unified Distributed Execution☆56Updated last year
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …☆145Updated last year
- The easiest way to integrate Kedro and Great Expectations☆54Updated 2 years ago
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆79Updated last week
- Read Delta tables without any Spark☆47Updated last year
- A tool and library for easily deploying applications on Apache YARN☆146Updated last year
- 🏷️ Git Tag Ops. Turn your Git repository into Artifact Registry or Model Registry.☆153Updated this week