skyplane-project / skyplaneLinks
π₯ Blazing fast bulk data transfers between any cloud π₯
β1,169Updated last year
Alternatives and similar repositories for skyplane
Users that are interested in skyplane are comparing it to the libraries listed below
Sorting:
- Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.β520Updated 2 years ago
- A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel appβ¦β349Updated last week
- Making data lake work for time seriesβ1,182Updated last year
- Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Woβ¦β795Updated last week
- Measure Amazon S3's performance from any location.β884Updated last year
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to youβ¦β245Updated last week
- Open Control Plane for Tables in Data Lakehouseβ369Updated this week
- A toolkit to run Ray applications on Kubernetesβ2,071Updated last week
- Chronon is a data platform for serving for AI/ML applications.β921Updated this week
- Lightweight Durable Python Workflowsβ980Updated this week
- An open-source ML pipeline development platformβ996Updated 9 months ago
- A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.β5,419Updated this week
- A stateful serverless platformβ244Updated 2 years ago
- Cloud Infrastructure as data in PostgreSQLβ602Updated 8 months ago
- Prepare requirements and deploy Flyte using Helmβ79Updated 6 months ago
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elasβ¦β672Updated last year
- Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflakeβ¦β676Updated this week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Liβ¦β1,811Updated this week
- InfiniCache: A cost-effective memory cache that is built atop ephemeral serverless functions (USENIX FAST'20)β255Updated 2 years ago
- New file format for storage of large columnar datasets.β622Updated last week
- A one-afternoon implementation of redis-like primitives with S3 Expressβ33Updated 11 months ago
- Klotho - write AWS applications at lightning speedβ1,145Updated last year
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scaleβ849Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewβ¦β2,116Updated 6 months ago
- Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apβ¦β942Updated last year
- A batteries-included Python client library for Kubernetes that feels familiar for folks who already know how to use kubectlβ914Updated last week
- A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.β558Updated last week
- Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.β293Updated last week
- Multy - Easily deploy multi cloud infrastructure. Write cloud-agnostic config deployed across multiple cloudsβ656Updated 2 years ago
- β663Updated 3 months ago