Alternatives and similar repositories for deepspeed-sagemaker-example:

Users that are interested in deepspeed-sagemaker-example are comparing it to the libraries listed below

• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆25Updated 11 months ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆218Updated this week
• aws-neuron / transformers-neuronx
  ☆102Updated last month
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• bigscience-workshop / architecture-objective
  ☆93Updated last year
• aws-samples / llm-evaluation-methodology
  ☆40Updated 3 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆144Updated 9 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆55Updated 10 months ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆135Updated last week
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆65Updated 6 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆67Updated 4 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆32Updated 7 months ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆154Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 8 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆142Updated last month
• aws-neuron / neuronx-distributed
  ☆51Updated last week
• aws-samples / amazon-sagemaker-bert-pytorch
  ☆64Updated last year
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆131Updated this week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆51Updated 2 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆42Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• hadasah / btm
  ☆72Updated 9 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆333Updated 4 months ago
• openai / moderation-api-release
  ☆122Updated 2 years ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆43Updated last month
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆170Updated last month
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year