A high-throughput and memory-efficient inference and serving engine for LLMs
☆24Jun 9, 2026Updated 4 months ago
Alternatives and similar repositories for upstreaming-to-vllm
Users that are interested in upstreaming-to-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆41Oct 13, 2026Updated 2 weeks ago
- ☆13Dec 20, 2025Updated 10 months ago
- ☆112Jan 16, 2025Updated last year
- Community maintained hardware plugin for vLLM on AWS Neuron☆59Oct 27, 2026Updated last week
- Training and inference on AWS Trainium and Inferentia chips.☆271Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository features Amazon SageMaker Ground Truth and explains how to ingest raw 3D point cloud data, label it, train a 3D object de…☆13Jun 23, 2022Updated 4 years ago
- ☆69Oct 16, 2026Updated 2 weeks ago
- ☆25Sep 8, 2026Updated last month
- MLSys competition for the best MOE NKI kernels☆48May 29, 2026Updated 5 months ago
- ☆74Jun 26, 2024Updated 2 years ago
- ☆14May 29, 2024Updated 2 years ago
- ☆13Dec 19, 2025Updated 10 months ago
- The repository guides you through generating a synthetic dataset for a QA-RAG application using the Bedrock API, Python and Langchain.☆22Sep 17, 2024Updated 2 years ago
- Open-weights speaker diarization for pyannote.audio 4.x: WavLM-Base+ / Conformer segmentation + SimAM-ResNet34 embeddings, by Reway.☆23Sep 10, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Oct 5, 2026Updated 3 weeks ago
- Seldon Core Operator for Kubernetes☆13Nov 5, 2019Updated 6 years ago
- ☆14Dec 20, 2023Updated 2 years ago
- Repository used to main group ACLs used by Kubeflow developers☆20Updated this week
- Experimental Managed Delivery plugin to enable deployment of Kubernetes resources via Spinnaker's keel microservice.☆13Apr 11, 2022Updated 4 years ago
- ☆27Updated this week
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆651Updated this week
- Mistral on AWS examples for Bedrock & SageMaker☆90Sep 14, 2026Updated last month
- This repository will soon contain all scripts and links to the annotated corpora of Tibetan.☆14Oct 8, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆17Jul 28, 2026Updated 3 months ago
- Large Language Model Hosting Container☆93Aug 27, 2026Updated 2 months ago
- Deploy and manage a self-hosted LLM using EKS.☆17Jan 29, 2025Updated last year
- This GitHub repository hosts the artifacts for the AWS Containers blog on developing Twelve Factor Apps on ECS using Fargate.☆24May 1, 2023Updated 3 years ago
- (current) A NGS analysis framework for WGS data, which automates the entire process of spinning up AWS EC2 spot instances and processing …☆22Aug 31, 2026Updated 2 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆163Jul 15, 2026Updated 3 months ago
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆28Aug 18, 2026Updated 2 months ago
- An example Terraform repo that utilizes the upstream EKS blueprints project from AWS Integration and Automation.☆15May 11, 2022Updated 4 years ago
- AWS Observability Accelerator☆23Jul 28, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repository is for the book "Fundamentals of Generative AI".☆18Aug 18, 2026Updated 2 months ago
- Puppet Module for installing and configuring the Confluent Platform☆14Dec 2, 2021Updated 4 years ago
- ☆16Jun 6, 2023Updated 3 years ago
- ☆20Nov 21, 2025Updated 11 months ago
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆16Jul 17, 2025Updated last year
- ☆18Oct 27, 2026Updated last week