philschmid / deepspeed-sagemaker-example

Related projects ⓘ

Alternatives and complementary repositories for deepspeed-sagemaker-example

• aws-neuron / transformers-neuronx
  ☆100Updated last month
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆207Updated this week
• aws-samples / llm-evaluation-methodology
  ☆35Updated last week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆127Updated last month
• amazon-science / auto-rag-eval
  Code repo for the ICML 2024 paper "Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation"
  ☆62Updated 4 months ago
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆22Updated 7 months ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• aws-neuron / neuronx-nemo-megatron
  ☆32Updated last month
• castorini / dhr
  Dense hybrid representations for text retrieval
  ☆61Updated last year
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆86Updated last year
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆123Updated this week
• google-research / t5x_retrieval
  ☆95Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆77Updated last year
• aws-samples / amazon-sagemaker-bert-pytorch
  ☆64Updated 10 months ago
• aws-neuron / neuronx-distributed
  ☆42Updated last week
• philschmid / llm-sagemaker-sample
  ☆49Updated 3 weeks ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆153Updated 10 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated 2 weeks ago
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆222Updated last month
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated 6 months ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆97Updated last year
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆76Updated last week
• nreimers / se-pytorch-xla
  ☆20Updated 3 years ago
• unicamp-dl / mMARCO
  A multilingual version of MS MARCO passage ranking dataset
  ☆141Updated last year
• cohere-ai / cohere-aws
  ☆58Updated last week
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆167Updated 3 months ago
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆22Updated 7 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆104Updated last month
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆88Updated 8 months ago