yuhuiaws / finetuning-and-deploying-llama-on-SagemakerLinks
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated 2 years ago
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated 2 years ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆17Updated 5 months ago
- Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.☆72Updated this week
- Spot Tagging Bot for Digital Assets☆18Updated 4 years ago
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆165Updated 5 months ago
- ☆26Updated last year
- ☆91Updated last year
- ☆115Updated last month
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆92Updated last week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆250Updated 4 months ago
- ☆53Updated this week
- ☆114Updated last week
- ☆13Updated 4 years ago
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Updated 4 months ago
- A generative AI-powered framework for testing virtual agents.☆286Updated 5 months ago
- ☆29Updated 5 months ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆27Updated this week
- ☆15Updated last year
- ☆280Updated last week
- ☆121Updated last week
- ☆14Updated 9 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆146Updated last month
- A tool to help you to copy an AMI from your Worldwide AWS account to China account.☆10Updated last year
- ☆21Updated 3 months ago
- Region expansion for solution Service Workbench on AWS. A platform that provides researchers with one-click access to collaborative works…☆11Updated last year
- ☆21Updated 9 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆147Updated last week
- ☆41Updated 8 months ago
- Onboard PaddleOCR with SageMaker Projects for MLOps, illustration with optical character recognition on identity documents☆21Updated 6 months ago
- ☆67Updated last year