philschmid / deepspeed-sagemaker-example

Related projects ⓘ

Alternatives and complementary repositories for deepspeed-sagemaker-example

• aws-neuron / transformers-neuronx
  ☆100Updated 2 months ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆209Updated this week
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆129Updated last month
• google-research / t5x_retrieval
  ☆95Updated last year
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆87Updated last year
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 6 months ago
• aws-samples / amazon-sagemaker-bert-pytorch
  ☆64Updated 11 months ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆60Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated last month
• awslabs / extending-the-context-length-of-open-source-llms
  ☆48Updated 2 weeks ago
• aws-neuron / neuronx-nemo-megatron
  ☆34Updated 2 months ago
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆22Updated 8 months ago
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• castorini / dhr
  Dense hybrid representations for text retrieval
  ☆62Updated last year
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• guyfe / Tweetsumm
  A dataset focused on summarization of dialogs, which represents the rich domain of Twitter customer care conversations
  ☆29Updated 11 months ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆179Updated 8 months ago
• bigscience-workshop / architecture-objective
  ☆93Updated last year
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆110Updated last year
• aws-samples / llm-evaluation-methodology
  ☆38Updated 3 weeks ago
• guilhermemr04 / scaling-zero-shot-retrieval
  No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
  ☆27Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆112Updated last month
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆97Updated last year
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆271Updated last year
• oriram / spider
  ☆55Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆77Updated last year
• for-ai / language-confusion
  Repository for the "Understanding and Mitigating Language Confusion in LLMs" paper
  ☆19Updated 4 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago