Large Language Model Hosting Container
☆93Aug 27, 2026Updated 2 months ago
Alternatives and similar repositories for llm-hosting-container
Users that are interested in llm-hosting-container are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Oct 24, 2023Updated 3 years ago
- ☆270Jul 28, 2026Updated 3 months ago
- A universal scalable machine learning model deployment solution☆254Updated this week
- collection of serverless machine learning use cases and examples including Hugging Face transformers, timm, Gradio☆16Dec 16, 2022Updated 3 years ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆46Aug 4, 2025Updated last year
- Training and inference on AWS Trainium and Inferentia chips.☆271Oct 14, 2026Updated 2 weeks ago
- ☆56Jun 26, 2025Updated last year
- Utility which provides a UI to do prompt engineering within SageMaker Studio.☆14Jul 5, 2023Updated 3 years ago
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆221Oct 21, 2026Updated last week
- ☆14Apr 22, 2024Updated 2 years ago
- yolosegment2labelme - a Python package that allows you to convert YOLO segmentation prediction results to LabelMe and anylabeling JSON fo…☆10May 8, 2024Updated 2 years ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆143Oct 7, 2024Updated 2 years ago
- ☆22Oct 18, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆32Jul 5, 2024Updated 2 years ago
- AWS Bedrock Agentcore sample illustrating multi tenancy☆12Dec 10, 2025Updated 10 months ago
- Compilation of examples of SageMaker inference options and other features.☆74Oct 28, 2025Updated last year
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 9 months ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Aug 17, 2026Updated 2 months ago
- ☆13Nov 1, 2024Updated last year
- Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…☆13Sep 19, 2024Updated 2 years ago
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆123Oct 27, 2024Updated 2 years ago
- Run vLLM on Amazon Sagemaker☆28Jul 19, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment☆31Jul 14, 2023Updated 3 years ago
- Find the optimal model serving solution for 🤗 Hugging Face models 🚀☆46Jul 20, 2025Updated last year
- ☆11Oct 11, 2023Updated 3 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Oct 19, 2024Updated 2 years ago
- Tune MPTs☆84Jun 17, 2023Updated 3 years ago
- A library for working with prompt templates locally or on the Hugging Face Hub.☆56Mar 5, 2025Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Apr 11, 2025Updated last year
- Official plugins for Hermes IDE☆20May 20, 2026Updated 5 months ago
- ☆20Apr 7, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- YoloV5 on SageMaker, including bring your own container☆18Nov 23, 2020Updated 5 years ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆25May 1, 2024Updated 2 years ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆413Nov 20, 2023Updated 2 years ago
- ☆19Mar 16, 2025Updated last year
- ☆68May 1, 2023Updated 3 years ago
- ☆10Feb 4, 2015Updated 11 years ago
- Hack Reactor Thesis Project☆10Jan 21, 2015Updated 11 years ago