GoogleCloudPlatform / slurm-gcp

Related projects: ⓘ

• GoogleCloudPlatform / cluster-toolkit
  Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…
  ☆188Updated this week
• google / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆69Updated this week
• GoogleCloudPlatform / ai-infra-cluster-provisioning
  ☆37Updated 2 weeks ago
• NVIDIA / mlperf-common
  NVIDIA's launch, startup, and logging scripts used by our MLPerf Training and HPC submissions
  ☆23Updated last month
• facebookresearch / GCD
  Computing the greatest common divisor with transformers, source code for the paper https//arxiv.org/abs/2308.15594
  ☆11Updated 5 months ago
• HazyResearch / nanoGPT-TK
  The simplest, fastest repository for training/finetuning medium-sized GPTs. Now, with kittens!
  ☆45Updated last month
• skypilot-org / skypilot-catalog
  ☆18Updated this week
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆40Updated last year
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆94Updated this week
• aws-samples / 1click-hpc
  Deploy your HPC Cluster on AWS in 20min. with just 1-Click.
  ☆62Updated 7 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆194Updated this week
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆41Updated 3 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 3 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆35Updated 5 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆26Updated last year
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆21Updated 5 months ago
• huggingface / roots-search-tool
  Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search
  ☆10Updated last year
• sylabs / sif
  Singularity Image Format (SIF) reference implementation.
  ☆17Updated 2 weeks ago
• aws-samples / aws-parallelcluster-megatron
  ☆13Updated 3 years ago
• Stability-AI / stability-hpc
  Deploy your HPC Cluster on AWS in 20min. with just 1-Click.
  ☆50Updated 3 weeks ago
• google-deepmind / multiscope
  Real-time visualisation
  ☆14Updated 2 months ago
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆36Updated last month
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆28Updated 8 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 3 weeks ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆43Updated 2 months ago
• yixiaoer / tpu-training-example
  ☆11Updated 2 months ago
• run-ai / vscode-genv
  GPU Environment Management for Visual Studio Code
  ☆35Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆62Updated this week
• google / saxml
  ☆117Updated this week
• ml-explore / mlx-c
  C API for MLX
  ☆68Updated last week