GoogleCloudPlatform / dataflux-client-python
This is the git repository for the Dataflux Python client library, providing fast listing and download of small files from GCS in Python. Also see https://github.com/GoogleCloudPlatform/dataflux-pytorch.
☆19Updated last week
Alternatives and similar repositories for dataflux-client-python:
Users that are interested in dataflux-client-python are comparing it to the libraries listed below
- A direct Google Cloud Storage integration for PyTorch☆35Updated this week
- MLPerf™ Storage Benchmark Suite☆130Updated 7 months ago
- High-performance Python librarys for connecting AI/ML frameworks with OSS storage.☆21Updated last week
- NVIDIA GPUDirect Storage Driver☆231Updated 3 months ago
- An I/O benchmark for deep Learning applications☆82Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆89Updated this week
- Health checks for Azure N- and H-series VMs.☆35Updated this week
- Tracking Ray Enhancement Proposals☆50Updated last month
- Beacon is a monitoring tool for HPC centers, and has been deployed on the current No.3 Sunway TaihuLight Supercomputer for over a year. W…☆20Updated 4 years ago
- Ephemeral distributed filesystem build up from the local storage of several nodes. It is an evolution of AdaFS done inside the NGIO proje…☆36Updated 3 years ago
- Writing RDMA applications on Linux Example programs☆45Updated last year
- IO500 Storage Benchmark source code☆112Updated last month
- ☆28Updated last month
- RDMA and SHARP plugins for nccl library☆184Updated this week
- ☆26Updated 2 years ago
- ☆25Updated 3 years ago
- verbs profiling library☆22Updated last year
- AIFM: High-Performance, Application-Integrated Far Memory☆119Updated 2 years ago
- ☆15Updated last week
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆328Updated 2 weeks ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆469Updated 2 weeks ago
- RDMA学习☆38Updated 6 years ago
- ☆53Updated 4 years ago
- Prefetching and efficient data path for memory disaggregation☆67Updated 4 years ago
- Open-Channel SSD emulator using memory☆21Updated 7 years ago
- ☆29Updated 3 years ago
- A multi-level dataflow tracer for capturing I/O calls from workflows.☆15Updated this week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆116Updated last year
- Spark RAPIDS Benchmarks – benchmark sets and utilities for the RAPIDS Accelerator for Apache Spark☆41Updated last week
- ☆94Updated 3 years ago