NVIDIA / ais-etl
Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on the fly and/or offline, locally to user data.
☆16Updated this week
Alternatives and similar repositories for ais-etl:
Users that are interested in ais-etl are comparing it to the libraries listed below
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆155Updated 7 months ago
- RAPIDS GPU-BDB☆108Updated last year
- Ray-based Apache Beam runner☆43Updated last year
- Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…☆92Updated last year
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆66Updated last year
- AIStore: scalable storage for AI applications☆1,465Updated this week
- A top-like tool for monitoring GPUs in a cluster☆86Updated last year
- Python bindings for UCX☆130Updated this week
- This repository contains example integrations between Determined and other ML products☆48Updated last year
- ☆38Updated 3 weeks ago
- A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …☆203Updated this week
- Morpheus Runtime Core (MRC)☆49Updated last month
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆315Updated this week
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆115Updated last week
- Flow with FlorDB 🌻☆155Updated 2 months ago
- Module, Model, and Tensor Serialization/Deserialization☆223Updated 2 months ago
- CUDA checkpoint and restore utility☆325Updated 2 months ago
- KvikIO - High Performance File IO☆204Updated this week
- Exoshuffle-CloudSort☆26Updated 2 years ago
- Triton backend for managing the model state tensors automatically in sequence batcher☆17Updated last year
- Repository for open inference protocol specification☆53Updated 9 months ago
- Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…☆245Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆358Updated this week
- Tools to deploy GPU clusters in the Cloud☆31Updated 2 years ago
- The Foundation for All Legate Libraries☆213Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆92Updated this week
- ☆30Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆44Updated 3 years ago
- ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.☆45Updated last month
- Container plugin for Slurm Workload Manager☆335Updated 5 months ago