Alternatives and similar repositories for skyplane:

Users that are interested in skyplane are comparing it to the libraries listed below

• marsupialtail / quokka
  Making data lake work for time series
  ☆1,164Updated 8 months ago
• Eventual-Inc / Daft
  Distributed data engine for Python/SQL designed for the cloud, powered by Rust
  ☆2,743Updated this week
• awslabs / mountpoint-s3
  A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
  ☆5,065Updated last week
• fugue-project / fugue
  A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…
  ☆2,074Updated 3 weeks ago
• slatedb / slatedb
  A cloud native embedded storage engine built on object storage.
  ☆1,933Updated this week
• lancedb / lance
  Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…
  ☆4,543Updated this week
• peak / s5cmd
  Parallel S3 and local filesystem execution tool.
  ☆3,011Updated 3 months ago
• kubernetes-sigs / kueue
  Kubernetes-native Job Queueing
  ☆1,745Updated this week
• airbnb / chronon
  Chronon is a data platform for serving for AI/ML applications.
  ☆793Updated this week
• nebuly-ai / nos
  Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…
  ☆654Updated last year
• treeverse / lakeFS
  lakeFS - Data version control for your data lake | Git for data
  ☆4,643Updated this week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆504Updated this week
• dvassallo / s3-benchmark
  Measure Amazon S3's performance from any location.
  ☆852Updated last year
• logicalclocks / rondb
  This is RonDB, a distribution of NDB Cluster developed and used by Hopsworks AB. It also contains development branches of RonDB.
  ☆621Updated this week
• someengineering / fixinventory
  Fix Inventory helps you identify and remove the most critical risks in AWS, GCP, Azure and Kubernetes.
  ☆1,958Updated 3 weeks ago
• delta-io / delta-sharing
  An open protocol for secure data sharing
  ☆826Updated this week
• bytewax / bytewax
  Python Stream Processing
  ☆1,714Updated last month
• infrahq / infra
  Infra provides authentication and access management to servers and Kubernetes clusters.
  ☆1,406Updated this week
• feathr-ai / feathr
  Feathr – A scalable, unified data and AI engineering platform for enterprise
  ☆1,891Updated last year
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆205Updated this week
• ploomber / ploomber
  The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
  ☆3,557Updated 7 months ago
• skypilot-org / skypilot
  SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…
  ☆7,724Updated this week
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆402Updated 7 months ago
• alantech / iasql
  Cloud Infrastructure as data in PostgreSQL
  ☆599Updated 2 months ago
• awslabs / aws-virtual-gpu-device-plugin
  AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
  ☆204Updated last year
• logicalclocks / hopsworks
  Hopsworks - Data-Intensive AI platform with a Feature Store
  ☆1,221Updated 2 months ago
• RunLLM / aqueduct
  Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
  ☆521Updated last year
• spiraldb / vortex
  An extensible, state of the art columnar file format
  ☆1,207Updated this week
• scratchdata / scratchdata
  Scratch is a swiss army knife for big data.
  ☆1,114Updated 9 months ago
• ray-project / kuberay
  A toolkit to run Ray applications on Kubernetes
  ☆1,708Updated this week