lithops-cloud / lithops
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
☆330Updated 2 months ago
Alternatives and similar repositories for lithops:
Users that are interested in lithops are comparing it to the libraries listed below
- Native Kubernetes integration for Dask☆322Updated 2 weeks ago
- A stateful serverless platform☆240Updated 2 years ago
- Wukong: A scalable and locality-enhanced serverless parallel framework (ACM SoCC'20)☆74Updated 6 months ago
- 🪴 Nebari - your open source data science platform☆293Updated this week
- Stand-alone pywren examples☆64Updated 5 years ago
- Plugin for Apache Airflow to execute serverless tasks using Lithops☆10Updated 2 years ago
- Fybrik☆132Updated last year
- A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …☆207Updated this week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Updated 2 years ago
- Lithops application examples☆11Updated 4 months ago
- Ray-based Apache Beam runner☆42Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆141Updated 3 months ago
- ☆38Updated this week
- Globus Compute: High Performance Function Serving for Science☆151Updated this week
- Nuclio Function Automation for Python and Jupyter☆89Updated 5 months ago
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,043Updated last week
- Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…☆92Updated last year
- A REST API to serve machine learning and deep learning models☆35Updated last month
- MLOps Python Library☆118Updated 3 years ago
- Provides remote kernel provisioners for various resource-managed clusters.☆38Updated 11 months ago
- Unified Distributed Execution☆52Updated 6 months ago
- 🔥 Blazing fast bulk data transfers between any cloud 🔥☆1,140Updated 11 months ago
- ☆89Updated 3 months ago
- Scalable array processing with bounded memory☆193Updated last month
- Kubeflow’s superfood for Data Scientists☆633Updated 2 years ago
- Jupyter Notebooks in S3 - Jupyter Contents Manager implementation☆251Updated last month
- UnionML: the easiest way to build and deploy machine learning microservices☆335Updated last year
- Customizable GitOps template for Kubeflow on AWS EKS☆10Updated 4 years ago
- Distributed SQL Engine in Python using Dask☆404Updated 8 months ago
- Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on t…☆16Updated this week