aws-samples / coldstart-recs-on-aws-trainiumLinks
End-to-end solution for cold-start recommendations using vLLM, DeepSeek Llama (8B & 70B), and FAISS on AWS Trainium (Trn1) with the Neuron SDK and NeuronX Distributed. Includes LLM-based interest expansion, embedding comparisons (T5 & SentenceTransformers), and scalable retrieval workflows.
☆8Updated 3 months ago
Alternatives and similar repositories for coldstart-recs-on-aws-trainium
Users that are interested in coldstart-recs-on-aws-trainium are comparing it to the libraries listed below
Sorting:
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆60Updated this week
- MLOps on Amazon EKS☆93Updated 3 weeks ago
- ☆24Updated 2 months ago
- ☆112Updated 6 months ago
- Deep learning benchmark utility and optimization tips on EKS.☆48Updated 5 years ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Updated 2 months ago
- ☆72Updated last year
- Amazon SageMaker operator for Kubernetes☆149Updated 2 years ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆44Updated last year
- ACK service controller for Amazon SageMaker☆48Updated 2 weeks ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆97Updated 4 years ago
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆205Updated last year
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆533Updated this week
- ☆51Updated last week
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆44Updated 2 months ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆331Updated this week
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated this week
- ☆44Updated last year
- SageMaker specific extensions to TensorFlow.☆54Updated last year
- KubeFlow on AWS☆186Updated last month
- Train and Deploy Machine Learning Models on Kubernetes using Amazon EKS☆167Updated 6 years ago
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆139Updated last month
- ☆145Updated 2 years ago
- A Data Platform built for AWS, powered by Kubernetes.☆148Updated 2 years ago
- Experiment tracking and metric logging for Amazon SageMaker notebooks and model training.☆127Updated last year
- Some crazy experiments☆34Updated 6 months ago
- ☆55Updated last year
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆45Updated last month
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆162Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆247Updated 3 months ago