yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated last year
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker:
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated last year
- ☆39Updated 3 weeks ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆16Updated last month
- A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS☆35Updated this week
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆80Updated this week
- ☆25Updated last year
- ☆68Updated this week
- ☆13Updated 2 years ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆42Updated 11 months ago
- Use natural language to Generate Amazon Athena SQL queries to fetch data.☆74Updated 5 months ago
- ☆113Updated last month
- ☆20Updated last year
- ☆14Updated 5 months ago
- ☆10Updated last year
- ☆13Updated last year
- ☆50Updated 11 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆238Updated 2 weeks ago
- SageMaker Studio Docker CLI Extension☆13Updated last year
- Spot Tagging Bot for Digital Assets☆18Updated 3 years ago
- ☆92Updated 8 months ago
- ☆20Updated 5 months ago
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆151Updated last month
- Pre-built examples of Generative AI agents with Bedrock across multiple industries.☆38Updated 2 weeks ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆56Updated last week
- ☆21Updated last month
- ☆14Updated 3 years ago
- Onboard PaddleOCR with SageMaker Projects for MLOps, illustration with optical character recognition on identity documents☆20Updated 2 months ago
- Region expansion for solution Service Workbench on AWS. A platform that provides researchers with one-click access to collaborative works…☆11Updated last year
- ☆43Updated 5 months ago
- ☆13Updated last week