Large Language Model Hosting Container
☆93Aug 27, 2026Updated 2 months ago
Alternatives and similar repositories for llm-hosting-container
Users that are interested in llm-hosting-container are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Oct 24, 2023Updated 3 years ago
- ☆270Updated this week
- A universal scalable machine learning model deployment solution☆258Updated this week
- collection of serverless machine learning use cases and examples including Hugging Face transformers, timm, Gradio☆16Dec 16, 2022Updated 3 years ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆46Aug 4, 2025Updated last year
- Training and inference on AWS Trainium and Inferentia chips.☆271Updated this week
- ☆56Jun 26, 2025Updated last year
- ☆14Oct 14, 2026Updated last month
- ☆114Jan 16, 2025Updated last year
- DeepEP: an efficient expert-parallel communication library☆16Nov 12, 2026Updated last week
- Utility which provides a UI to do prompt engineering within SageMaker Studio.☆14Jul 5, 2023Updated 3 years ago
- ☆10May 16, 2023Updated 3 years ago
- ☆14Apr 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆221Oct 21, 2026Updated 3 weeks ago
- yolosegment2labelme - a Python package that allows you to convert YOLO segmentation prediction results to LabelMe and anylabeling JSON fo…☆10May 8, 2024Updated 2 years ago
- ☆14Dec 20, 2023Updated 2 years ago
- ☆12Jun 1, 2023Updated 3 years ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆143Oct 7, 2024Updated 2 years ago
- ☆22Oct 18, 2023Updated 3 years ago
- Reinvent 2019 GPU lab☆13May 12, 2020Updated 6 years ago
- ☆32Jul 5, 2024Updated 2 years ago
- One stop shop for running AI/ML on AWS.☆1,210Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Mar 2, 2024Updated 2 years ago
- Apps that run on modal.com☆13Sep 14, 2025Updated last year
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Aug 17, 2026Updated 3 months ago
- ☆69Oct 16, 2026Updated last month
- ☆13Nov 1, 2024Updated 2 years ago
- ☆15Apr 10, 2024Updated 2 years ago
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆123Oct 27, 2024Updated 2 years ago
- Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment☆31Jul 14, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Multi-Agent AI App from Scratch in python without any depedency of framework☆15Jan 7, 2025Updated last year
- CloudFormation templates and scripts demonstrating how to build a promotion recommendation system using Kinesis and SageMaker.☆28Apr 24, 2018Updated 8 years ago
- ☆11Oct 11, 2023Updated 3 years ago
- Find the optimal model serving solution for 🤗 Hugging Face models 🚀☆46Jul 20, 2025Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Apr 11, 2024Updated 2 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Oct 19, 2024Updated 2 years ago
- Example code for AWS Neuron SDK developers building inference and training applications☆163Nov 9, 2026Updated last week
Are these results useful?