Alternatives and similar repositories for slurm_ubuntu_gpu_cluster:

Users that are interested in slurm_ubuntu_gpu_cluster are comparing it to the libraries listed below

• nateGeorge / slurm_gpu_ubuntu
  Instructions for setting up a SLURM cluster using Ubuntu 18.04.3 with GPUs.
  ☆140Updated 4 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆102Updated last month
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆13Updated last year
• microsoft / DeepSpeed-Kernels
  ☆57Updated 7 months ago
• NVIDIA / cloudai
  CloudAI Benchmark Framework
  ☆47Updated this week
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆26Updated last week
• axonn-ai / axonn
  A parallel framework for training deep neural networks
  ☆49Updated this week
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆25Updated 4 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆32Updated 5 months ago
• mlcommons / logging
  MLPerf™ logging library
  ☆32Updated last week
• casper-hansen / AutoAWQ_kernels
  ☆62Updated last month
• NVIDIA / ngc-container-replicator
  NGC Container Replicator
  ☆28Updated 2 years ago
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆311Updated 2 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated last month
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆62Updated last month
• KuntaiDu / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆11Updated this week
• TorchMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆112Updated last month
• Infini-AI-Lab / MagicDec
  Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆107Updated last month
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆204Updated 4 months ago
• MayDomine / Burst-Attention
  Distributed IO-aware Attention algorithm
  ☆18Updated 4 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated last year
• anyscale / llm-continuous-batching-benchmarks
  ☆114Updated 10 months ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆39Updated 2 months ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆83Updated 2 months ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated last year
• NVIDIA / numba-cuda
  The CUDA target for Numba
  ☆41Updated last week
• prateeky2806 / ComPEFT
  ☆25Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆64Updated this week
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆19Updated 5 months ago