yuhuiaws / finetuning-and-deploying-llama-on-SagemakerLinks
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated 2 years ago
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated 2 years ago
- Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.☆74Updated 2 months ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆17Updated 7 months ago
- ☆26Updated last year
- ☆42Updated 2 weeks ago
- ☆57Updated last month
- Spot Tagging Bot for Digital Assets☆18Updated 4 years ago
- ☆116Updated last month
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆167Updated 7 months ago
- ☆14Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 6 months ago
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆93Updated last month
- Example code for AWS Neuron SDK developers building inference and training applications☆149Updated 2 weeks ago
- ☆13Updated 4 years ago
- ☆282Updated 2 months ago
- ☆124Updated this week
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆32Updated this week
- ☆91Updated last year
- Hands-on workshop for distributed training and hosting on SageMaker☆148Updated 2 weeks ago
- ☆30Updated last month
- ☆56Updated this week
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Updated 6 months ago
- Foundation Model Evaluations Library☆265Updated 2 months ago
- ☆121Updated 2 months ago
- 自己整理了一些ML入门的知识,以及ML项目中的一些经验总结分享☆315Updated last year
- ☆21Updated 11 months ago
- ☆21Updated 5 months ago
- This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.☆126Updated 8 months ago
- ☆42Updated last week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆357Updated last week