GoogleCloudPlatform / dataflux-client-python
This is the git repository for the Dataflux Python client library, providing fast listing and download of small files from GCS in Python. Also see https://github.com/GoogleCloudPlatform/dataflux-pytorch.
☆19Updated 5 months ago
Alternatives and similar repositories for dataflux-client-python:
Users that are interested in dataflux-client-python are comparing it to the libraries listed below
- A direct Google Cloud Storage integration for PyTorch☆35Updated 2 months ago
- Health checks for Azure N- and H-series VMs.☆32Updated 2 weeks ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆115Updated last year
- Beacon is a monitoring tool for HPC centers, and has been deployed on the current No.3 Sunway TaihuLight Supercomputer for over a year. W…☆20Updated 4 years ago
- CUDA checkpoint and restore utility☆292Updated 3 weeks ago
- MLPerf™ Storage Benchmark Suite☆118Updated 6 months ago
- RDMA and SHARP plugins for nccl library☆176Updated last month
- verbs profiling library☆22Updated last year
- Elastic ephemeral storage☆118Updated 2 years ago
- A kernel module to enable RDMA transfers to/from IO, PFN and DAX mapped memory☆10Updated 9 years ago
- ☆94Updated 2 years ago
- Snowflake dataset containing statistics for 70 million queries over 14 day period☆111Updated 3 years ago
- Ephemeral distributed filesystem build up from the local storage of several nodes. It is an evolution of AdaFS done inside the NGIO proje…☆36Updated 3 years ago
- NVIDIA NCCL Tests for Distributed Training☆79Updated this week
- Tracking Ray Enhancement Proposals☆48Updated last month
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆77Updated 10 months ago
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆163Updated this week
- High-performance Python librarys for connecting AI/ML frameworks with OSS storage.☆20Updated last month
- An I/O benchmark for deep Learning applications☆76Updated this week
- Magnum IO community repo☆84Updated last month
- ☆326Updated 9 months ago
- Suite of contentious microbenchmarks☆53Updated 7 years ago
- A collection of unit test to RDMA providers using libibverbs☆29Updated 3 weeks ago
- A validation and profiling tool for AI infrastructure☆292Updated this week
- An RDMA-enabled Distributed Persistent Memory File System☆156Updated 7 years ago
- ☆42Updated 9 months ago
- LITE Kernel RDMA Support for Datacenter Applications. SOSP 2017.☆107Updated 4 years ago
- cricket is a virtualization solution for GPUs☆181Updated this week
- NVIDIA GPUDirect Storage Driver☆224Updated 2 months ago
- ☆185Updated 5 years ago