yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆21Updated last year
Related projects ⓘ
Alternatives and complementary repositories for finetuning-and-deploying-llama-on-Sagemaker
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Updated last year
- ☆22Updated 8 months ago
- aws-solutions-library-samples / guidance-for-custom-search-of-an-enterprise-knowledge-base-with-amazon-opensearch-serviceThis Guidance demonstrates how to build an application for search based on the information in an enterprise knowledge base through the de…☆8Updated 2 weeks ago
- ☆13Updated last year
- ☆15Updated this week
- Seamlessly invoke Amazon Bedrock or your custom models, enabling a smooth experience with AWS GenAI services.☆49Updated this week
- ☆82Updated 2 weeks ago
- A solution guidance for Generative BI using Amazon Bedrock, Amazon OpenSearch with RAG☆122Updated last month
- ☆14Updated 3 years ago
- ☆32Updated last week
- ☆91Updated 3 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆43Updated 6 months ago
- ☆16Updated 2 weeks ago
- A generative AI-powered framework for testing virtual agents.☆106Updated last month
- ☆45Updated 6 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆196Updated this week
- Spot Tagging Bot for Digital Assets☆18Updated 3 years ago
- SageMaker Studio Docker CLI Extension☆13Updated 7 months ago
- ☆19Updated 10 months ago
- This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.☆90Updated last week
- Region expansion for solution Service Workbench on AWS. A platform that provides researchers with one-click access to collaborative works…☆11Updated 10 months ago
- Foundation Model Evaluations Library☆209Updated this week
- ☆37Updated 3 weeks ago
- A local GUI interacting with Amazon Bedrock with multiple LLM, e.g. Claude, Titan, AI21, Cohere☆13Updated 6 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆128Updated last month
- ☆31Updated this week
- ☆257Updated 2 months ago
- Use natural language to Generate Amazon Athena SQL queries to fetch data.☆49Updated 2 weeks ago