yuhuiaws / finetuning-and-deploying-llama-on-SagemakerLinks
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated last year
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated last year
- ☆104Updated this week
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆16Updated 2 months ago
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆83Updated 2 weeks ago
- ☆47Updated 2 weeks ago
- ☆14Updated last year
- ☆13Updated 2 years ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆41Updated last year
- ☆25Updated last year
- SageMaker Studio Docker CLI Extension☆13Updated last year
- ☆18Updated last month
- A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS☆44Updated this week
- ☆102Updated this week
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆155Updated 2 months ago
- ☆20Updated 7 months ago
- ☆91Updated 10 months ago
- ☆14Updated 4 years ago
- Region expansion for solution Service Workbench on AWS. A platform that provides researchers with one-click access to collaborative works…☆11Updated last year
- ☆20Updated last year
- Spot Tagging Bot for Digital Assets☆18Updated 3 years ago
- Stable Diffusion web UI☆17Updated last year
- Onboard PaddleOCR with SageMaker Projects for MLOps, illustration with optical character recognition on identity documents☆21Updated 3 months ago
- ☆47Updated last month
- ☆41Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated this week
- ☆28Updated last month
- A tool to help you to copy an AMI from your Worldwide AWS account to China account.☆10Updated last year
- Mistral on AWS examples for Bedrock & SageMaker☆70Updated last week
- ☆44Updated 7 months ago
- ☆30Updated 7 months ago