aws-samples / aws-parallelcluster-megatron
☆14Updated 3 years ago
Alternatives and similar repositories for aws-parallelcluster-megatron:
Users that are interested in aws-parallelcluster-megatron are comparing it to the libraries listed below
- ☆34Updated 2 months ago
- ☆23Updated 10 months ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆42Updated last year
- Sagemaker Studio Docker UI Extension☆11Updated 10 months ago
- ☆14Updated last year
- SageMaker Studio Docker CLI Extension☆13Updated 10 months ago
- benchmarking some transformer deployments☆26Updated last year
- Deploy your HPC Cluster on AWS in 20min. with just 1-Click.☆63Updated 11 months ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- Scripts to customize AWS ParallelCluster☆23Updated 4 months ago
- A high performance data access library for machine learning tasks☆74Updated last year
- A sample pattern for running CI tests on Modal☆14Updated 5 months ago
- ☆40Updated last week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆52Updated 3 weeks ago
- ☆18Updated 4 months ago
- Create an Amazon EKS cluster and run a distributed training example☆28Updated 6 months ago
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- Openfold inference architecture for Amazon EKS☆11Updated 4 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆135Updated last week
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- ☆102Updated last month
- Deploy your HPC Cluster on AWS in 20min. with just 1-Click.☆53Updated 3 weeks ago
- ☆11Updated last week
- Monitoring Dashboard for AWS ParallelCluster☆35Updated 4 months ago
- ☆22Updated 2 months ago
- Parallel data preprocessing for NLP and ML.☆34Updated 3 months ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆32Updated 8 months ago
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆56Updated 2 years ago
- Various transformers for FSDP research☆36Updated 2 years ago