aws-neuron / neuronx-nemo-megatron

Related projects: ⓘ

• aws-neuron / neuronx-distributed
  ☆39Updated this week
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆21Updated 5 months ago
• aws-neuron / transformers-neuronx
  ☆94Updated this week
• aws-samples / aws-parallelcluster-megatron
  ☆13Updated 3 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆120Updated 2 weeks ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆193Updated this week
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆40Updated 5 months ago
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆40Updated last year
• aws-samples / aws-samples-for-ray
  ☆62Updated 2 months ago
• awslabs / ml-io
  A high performance data access library for machine learning tasks
  ☆74Updated 9 months ago
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated 5 months ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆31Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated last month
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆145Updated this week
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆242Updated 2 years ago
• philschmid / deepspeed-sagemaker-example
  ☆18Updated last year
• facebookresearch / torchrec
  ☆40Updated this week
• huggingface / tune
  ☆86Updated 2 years ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆66Updated 7 months ago
• microsoft / varuna
  ☆234Updated last month
• GoogleCloudPlatform / nvidia-merlin-on-vertex-ai
  This repository compiles prescriptive guidance and code samples for the operationalization of NVIDIA Merlin framework on Google Cloud Ver…
  ☆34Updated 2 years ago
• google / praxis
  ☆172Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆152Updated this week
• mgmalek / efficient_cross_entropy
  ☆66Updated 3 months ago
• aws-samples / sagemaker-studio-docker-ui-extension
  Sagemaker Studio Docker UI Extension
  ☆11Updated 5 months ago
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆177Updated this week
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆60Updated this week