Alternatives and similar repositories for deepspeed-sagemaker-example:

Users that are interested in deepspeed-sagemaker-example are comparing it to the libraries listed below

• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆60Updated last year
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆217Updated this week
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆24Updated 9 months ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• aws-samples / amazon-sagemaker-bert-pytorch
  ☆64Updated last year
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 7 months ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆97Updated last year
• aws-neuron / transformers-neuronx
  ☆102Updated this week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆50Updated last month
• aws / sagemaker-huggingface-inference-toolkit
  ☆242Updated 3 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆142Updated 7 months ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆132Updated this week
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆154Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆66Updated 2 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆42Updated last year
• aws-neuron / neuronx-distributed
  ☆50Updated this week
• xaiguy / chippy
  ☆13Updated last year
• oriram / spider
  ☆55Updated 2 years ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆97Updated 10 months ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆207Updated last year
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆133Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year