Alternatives and similar repositories for deepspeed-sagemaker-example

Users that are interested in deepspeed-sagemaker-example are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆239Updated this week
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆26Updated last year
• aws / sagemaker-huggingface-inference-toolkit
  ☆266Updated 4 months ago
• aws-samples / amazon-sagemaker-bert-pytorch
  ☆64Updated last year
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆145Updated last week
• aws-samples / llm-evaluation-methodology
  ☆44Updated 10 months ago
• aws-neuron / transformers-neuronx
  ☆111Updated 7 months ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆89Updated 2 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated last week
• awslabs / sagemaker-debugger
  Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors
  ☆162Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 10 months ago
• philschmid / huggingface-sagemaker-workshop-series
  Enterprise Scale NLP with Hugging Face & SageMaker Workshop series
  ☆241Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆141Updated 10 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆135Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 2 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆151Updated last year
• philschmid / llm-sagemaker-sample
  ☆59Updated 9 months ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆155Updated last year
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆252Updated last month
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 8 months ago
• yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
  Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the …
  ☆24Updated 2 years ago
• zphang / transformers
  Code and models for BERT on STILTs
  ☆52Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• aws-samples / amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve
  Twin Neural Network Training with PyTorch and fast.ai and its Deployment with TorchServe on Amazon SageMaker
  ☆11Updated last year
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆335Updated 8 months ago
• cohere-ai / cohere-aws
  ☆62Updated 4 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆91Updated 3 weeks ago