yuhuiaws / finetuning-and-deploying-llama-on-SagemakerLinks
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Updated last year
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated 2 years ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆17Updated 4 months ago
- ☆25Updated last year
- ☆111Updated 2 weeks ago
- Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.☆58Updated last week
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆159Updated 3 months ago
- ☆49Updated last week
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆88Updated last month
- ☆91Updated 11 months ago
- ☆108Updated this week
- ☆117Updated 2 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆247Updated 3 months ago
- Spot Tagging Bot for Digital Assets☆18Updated 3 years ago
- ☆277Updated 6 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆143Updated last week
- ☆21Updated 8 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated last month
- ☆48Updated last week
- A generative AI-powered framework for testing virtual agents.☆263Updated 3 months ago
- ☆13Updated 4 years ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆24Updated this week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆247Updated last week
- ☆64Updated last year
- ☆14Updated 8 months ago
- ☆44Updated 8 months ago
- Use natural language to Generate Amazon Athena SQL queries to fetch data.☆87Updated 8 months ago
- This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.☆121Updated 4 months ago
- 自己整理了一些ML入门的知识，以及ML项目中的一些经验总结分享☆310Updated 10 months ago
- Foundation Model Evaluations Library☆258Updated 2 weeks ago
- SageMaker Studio Docker CLI Extension☆13Updated last year