GoogleCloudPlatform / dataflux-client-python
This is the git repository for the Dataflux Python client library, providing fast listing and download of small files from GCS in Python. Also see https://github.com/GoogleCloudPlatform/dataflux-pytorch.
☆19Updated 4 months ago
Alternatives and similar repositories for dataflux-client-python:
Users that are interested in dataflux-client-python are comparing it to the libraries listed below
- A direct Google Cloud Storage integration for PyTorch☆33Updated last month
- High-performance Python librarys for connecting AI/ML frameworks with OSS storage.☆20Updated this week
- ☆34Updated last month
- Unified high-performance Python client for object and file stores.☆12Updated 3 weeks ago
- High-performance application networking for large-scale production.☆23Updated 2 years ago
- Pytorch process group third-party plugin for UCC☆20Updated 9 months ago
- Argobots bindings for the Mercury RPC library☆22Updated last week
- Speed up fsspec data access with Alluxio distributed caching.☆13Updated this week
- This is repository for a I/O benchmark which represents Scientific Deep Learning Workloads.☆23Updated 2 years ago
- A multi-platform experimentation framework written in python.☆43Updated this week
- High Performance Network Library for RDMA☆27Updated 2 years ago
- UnifyFS: A file system for burst buffers☆110Updated 3 weeks ago
- A Benchmark for Real-Time Relational Data Feature Extraction (VLDB'23 Best Industry Paper Runnerup)☆49Updated last year
- ☆24Updated this week
- RDMA core userspace libraries and daemons☆13Updated 2 weeks ago
- ☆15Updated last month
- Dragon distributed runtime for HPC and AI applications and workflows☆63Updated last month
- ☆14Updated 2 years ago
- CloudAI Benchmark Framework☆47Updated this week
- NVIDIA DPU OPs collection☆13Updated last year
- IO500 Storage Benchmark source code☆110Updated this week
- An I/O benchmark for deep Learning applications☆72Updated 2 months ago
- MLPerf™ Storage Benchmark Suite☆115Updated 5 months ago
- Official repository of Alibaba erdma drivers☆27Updated last year
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆22Updated 7 months ago
- ☆14Updated 3 months ago
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆156Updated this week
- A benchmark suite for measuring HDF5 performance.☆39Updated 5 months ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆113Updated last year
- This is the source code for our (Tobias Ziegler, Jacob Nelson-Slivon, Carsten Binnig and Viktor Leis) published paper at SIGMOD’23: Desig…☆25Updated 3 months ago