Alternatives and similar repositories for gcs-connector-for-pytorch:

Users that are interested in gcs-connector-for-pytorch are comparing it to the libraries listed below

• GoogleCloudPlatform / dataflux-client-python
  This is the git repository for the Dataflux Python client library, providing fast listing and download of small files from GCS in Python.…
  ☆19Updated 3 weeks ago
• AI-Hypercomputer / gpu-recipes
  Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
  ☆56Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆315Updated this week
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆115Updated this week
• google / saxml
  ☆137Updated this week
• GoogleCloudPlatform / ai-on-gke
  AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…
  ☆302Updated last week
• GoogleCloudPlatform / ml-auto-solutions
  A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…
  ☆43Updated this week
• run-ai / runai-model-streamer
  ☆191Updated 2 weeks ago
• AI-Hypercomputer / tpu-recipes
  ☆19Updated last week
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆156Updated last year
• GoogleCloudPlatform / automlops
  Build MLOps Pipelines in Minutes
  ☆239Updated 3 weeks ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆59Updated 3 weeks ago
• awslabs / s3-connector-for-pytorch
  The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
  ☆153Updated last week
• GoogleCloudPlatform / nvidia-nemo-on-gke
  Training NVIDIA NeMo Megatron Large Language Model (LLM) using NeMo Framework on Google Kubernetes Engine
  ☆12Updated 3 weeks ago
• GoogleCloudPlatform / ml-testing-accelerators
  Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)
  ☆64Updated 4 months ago
• googleapis / python-bigquery-dataframes
  BigQuery DataFrames
  ☆237Updated this week
• rapidsai / cuvs
  cuVS - a library for vector search and clustering on the GPU
  ☆373Updated this week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆281Updated last week
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆46Updated 4 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆156Updated 4 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆235Updated this week
• unionai-oss / llm-fine-tuning
  Fine-tuning LLMs on Flyte and Union Cloud
  ☆28Updated last year
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆325Updated 2 months ago
• Ark-kun / google_cloud_mlflow
  Experimental MLflow plugin for Google Cloud Vertex AI
  ☆37Updated last year
• ppl-ai / libfabric-efa-demo
  ☆58Updated 2 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆107Updated 2 months ago
• GoogleCloudPlatform / slurm-gcp
  ☆38Updated 2 weeks ago
• google / dataflow-ml-starter
  ☆22Updated 5 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆112Updated last year
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆32Updated 3 weeks ago