yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated last year
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker:
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
- ☆25Updated last week
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated last year
- ☆25Updated 10 months ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆13Updated 2 weeks ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆43Updated 8 months ago
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆66Updated last week
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆133Updated 3 months ago
- ☆13Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆132Updated 2 weeks ago
- Region expansion for solution Service Workbench on AWS. A platform that provides researchers with one-click access to collaborative works…☆11Updated last year
- ☆92Updated 6 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆220Updated this week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆52Updated this week
- ☆37Updated last month
- Sample solution to build a deployment pipeline for Amazon SageMaker.☆13Updated 2 years ago
- ☆14Updated 3 years ago
- ☆19Updated last year
- ☆43Updated 8 months ago
- Use natural language to Generate Amazon Athena SQL queries to fetch data.☆59Updated 2 months ago
- ☆38Updated this week
- ☆66Updated this week
- ☆58Updated 7 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆130Updated 2 months ago
- Onboard PaddleOCR with SageMaker Projects for MLOps, illustration with optical character recognition on identity documents☆20Updated 4 months ago
- ☆40Updated 3 months ago
- aws-solutions-library-samples / guidance-for-conversational-chatbots-using-retrieval-augmented-generation-on-awsThis Guidance demonstrates how to combine Retrieval Augmented Generation (RAG) with AWS services to build generative AI applications.☆37Updated 3 months ago
- This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.☆99Updated 2 months ago
- ☆10Updated last year
- ☆58Updated last week
- ☆70Updated last week