NVIDIA / ais-etlLinks
Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on the fly and/or offline, locally to user data.
☆17Updated last week
Alternatives and similar repositories for ais-etl
Users that are interested in ais-etl are comparing it to the libraries listed below
Sorting:
- RAPIDS GPU-BDB☆108Updated last year
- ☆57Updated last week
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆157Updated last week
- Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.☆521Updated 2 years ago
- Utilities for Dask and CUDA interactions☆318Updated this week
- Python bindings for UCX☆140Updated 2 months ago
- Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…☆299Updated this week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆51Updated 3 years ago
- Pygloo provides Python bindings for Gloo.☆22Updated 4 months ago
- Ray-based Apache Beam runner☆42Updated 2 years ago
- Morpheus Runtime Core (MRC)☆50Updated last month
- Chassis turns machine learning models into portable container images that can run just about anywhere.☆86Updated last year
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆255Updated this week
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆67Updated last year
- A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel app…☆354Updated last month
- ☆30Updated 2 years ago
- Unified Distributed Execution☆57Updated last year
- 🪴 Nebari - your open source data science platform☆316Updated last week
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated last month
- TRITONCACHE implementation of a Redis cache☆16Updated 3 weeks ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- Distributed persistent Task Queue running on Dask☆38Updated 2 years ago
- Globus Compute: High Performance Function Serving for Science☆157Updated last week
- Python SDK for XetHub☆59Updated last year
- KvikIO - High Performance File IO☆233Updated last week
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆192Updated last week
- ☆39Updated last week
- Unified storage framework for the entire machine learning lifecycle☆155Updated last year
- GPU accelerated cross filtering with cuDF.☆305Updated 2 weeks ago
- ☆22Updated 2 years ago