yuhuiaws / finetuning-and-deploying-llama-on-SagemakerLinks
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated 2 years ago
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated 2 years ago
- Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.☆74Updated 5 months ago
- ☆62Updated last week
- ☆115Updated 4 months ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆17Updated 10 months ago
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆97Updated this week
- ☆26Updated last year
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Updated 9 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Updated 9 months ago
- ☆132Updated last week
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆170Updated 10 months ago
- ☆14Updated last year
- ☆21Updated last year
- ☆287Updated 5 months ago
- ☆13Updated 4 years ago
- ☆56Updated 3 months ago
- Spot Tagging Bot for Digital Assets☆18Updated 4 years ago
- ☆91Updated last year
- ☆34Updated last month
- ☆123Updated 5 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆156Updated 2 weeks ago
- ☆58Updated this week
- SageMaker Studio Docker CLI Extension☆13Updated last year
- Foundation Model Evaluations Library☆276Updated 5 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆41Updated last year
- A generative AI-powered framework for testing virtual agents.☆335Updated last month
- ☆21Updated 8 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆151Updated 2 months ago
- ☆45Updated 5 months ago
- ☆15Updated last year