Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the fine tuned llama on Sagemaker with server side batch.
☆24Aug 1, 2023Updated 2 years ago
Alternatives and similar repositories for finetuning-and-deploying-llama-on-Sagemaker
Users that are interested in finetuning-and-deploying-llama-on-Sagemaker are comparing it to the libraries listed below
Sorting:
- This is a sample about how to run stanford_alpaca on Amazon SageMaker, only for demo use.☆14Jul 3, 2023Updated 2 years ago
- ☆13May 17, 2021Updated 4 years ago
- Python script that translates pptx files using Amazon Translate service.☆33Oct 23, 2024Updated last year
- ☆11Feb 1, 2024Updated 2 years ago
- This solution provides a way to deploy SageMaker Studio in a private and secure environment. The solution integrates with a Custom SAML 2…☆14Apr 11, 2023Updated 2 years ago
- ☆15Jan 27, 2026Updated last month
- ☆13Oct 19, 2023Updated 2 years ago
- End-to-End Neural Event Coreference Resolution☆11Jun 18, 2023Updated 2 years ago
- Research Artifact For Our Submission To VLDB☆10Oct 27, 2021Updated 4 years ago
- Mac port of Torcs, The Open Racing Car Simulator☆11Jun 16, 2010Updated 15 years ago
- ☆13Oct 9, 2023Updated 2 years ago
- MIC-CIS entry in PharmaCoNER, Bacteria Biotope (BB 2029) & SeeDev 2019 Shared Tasks in EMNLP '19☆11Feb 22, 2020Updated 6 years ago
- AWS Lambda precomiled binaries for lxml 3.6.4 built for python 2.7 and python 3.6 runtimes☆12Apr 17, 2019Updated 6 years ago
- Code for the paper "Knowledge-Aware Federated Active Learning with Non-IID Data", ICCV2023☆10Sep 8, 2023Updated 2 years ago
- ☆11Apr 21, 2023Updated 2 years ago
- an ML & deep learning algorithms/models to assess spoken English language proficiency +++ it transforms sounds/language in a 3-dimension …☆16Jun 11, 2019Updated 6 years ago
- Finetuning LLaMA with DeepSpeed☆10Apr 14, 2023Updated 2 years ago
- Custom docker container for Catboost on Amazon SageMaker☆13Sep 22, 2022Updated 3 years ago
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated 10 months ago
- ☆11Sep 6, 2019Updated 6 years ago
- ☆287Aug 20, 2025Updated 6 months ago
- An Efficient Supply Chain Management System using Blockchain & Machine Learning.☆10Nov 27, 2019Updated 6 years ago
- NVIDIA GPU autoscaling on Amazon EKS☆12Jul 7, 2019Updated 6 years ago
- Official repository for ALT (ALignment with Textual feedback).☆10Jul 25, 2024Updated last year
- ☆18May 20, 2025Updated 9 months ago
- 命名实体识别☆12Dec 21, 2020Updated 5 years ago
- Torch 7 + Android port of Neural style algorithm☆10May 10, 2016Updated 9 years ago
- Source code of FedAttack.☆11Feb 9, 2022Updated 4 years ago
- Python code for "Bayesian hybrid matrix factorisation for data integration", published at 20th International Conference on Artificial Int…☆13Jun 10, 2018Updated 7 years ago
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆13Sep 2, 2024Updated last year
- Collection of different types of transformers for learning purposes☆12Jan 30, 2020Updated 6 years ago
- Example of using VLFeat's SLIC implementation from C++.☆10Aug 21, 2016Updated 9 years ago
- Get start with RL, today☆14Sep 9, 2025Updated 6 months ago
- Source code for "SimCKP: Simple Contrastive Learning of Keyphrase Representations", Findings of EMNLP 2023☆12Jun 20, 2025Updated 8 months ago
- ☆57Feb 5, 2026Updated last month
- Use BERT to train a classification model and deploy the model by tensorflow serving☆50Mar 5, 2021Updated 5 years ago
- Many pieces made with Openscad☆15Jul 29, 2015Updated 10 years ago
- SageMaker Studio Docker CLI Extension☆13Apr 17, 2024Updated last year
- Segment an image into super pixels☆21Dec 12, 2011Updated 14 years ago