skyplane-project / skyplaneLinks
🔥 Blazing fast bulk data transfers between any cloud 🔥
☆1,150Updated last year
Alternatives and similar repositories for skyplane
Users that are interested in skyplane are comparing it to the libraries listed below
Sorting:
- A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel app…☆341Updated this week
- Cloud Infrastructure as data in PostgreSQL☆601Updated 6 months ago
- Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Ap…☆940Updated 9 months ago
- Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.☆521Updated 2 years ago
- A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.☆5,303Updated this week
- An open-source ML pipeline development platform☆995Updated 6 months ago
- Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake…☆662Updated this week
- Parallel S3 and local filesystem execution tool.☆3,474Updated last month
- Chronon is a data platform for serving for AI/ML applications.☆827Updated this week
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,161Updated this week
- Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Wo…☆756Updated this week
- Making data lake work for time series☆1,179Updated 11 months ago
- InfiniCache: A cost-effective memory cache that is built atop ephemeral serverless functions (USENIX FAST'20)☆254Updated 2 years ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆707Updated this week
- Multy - Easily deploy multi cloud infrastructure. Write cloud-agnostic config deployed across multiple clouds☆654Updated 2 years ago
- Klotho - write AWS applications at lightning speed☆1,147Updated 11 months ago
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆666Updated last year
- 🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, with Estuary Flow. 🌊☆778Updated this week
- A toolkit to run Ray applications on Kubernetes☆1,921Updated this week
- Open Control Plane for Tables in Data Lakehouse☆362Updated this week
- A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …☆233Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,101Updated 4 months ago
- New file format for storage of large columnar datasets.☆577Updated this week
- Measure Amazon S3's performance from any location.☆865Updated last year
- Prepare requirements and deploy Flyte using Helm☆73Updated 3 months ago
- lakeFS - Data version control for your data lake | Git for data☆4,794Updated this week
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆770Updated this week
- A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.☆538Updated this week
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆172Updated this week
- A stateful serverless platform☆242Updated 2 years ago