This is a landscape of the infrastructure that powers the generative AI ecosystem
☆156Oct 16, 2024Updated last year
Alternatives and similar repositories for ai-infra-landscape
Users that are interested in ai-infra-landscape are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains statistics about the AI Infrastructure products.☆16Feb 27, 2025Updated last year
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- envd Website☆12Aug 24, 2026Updated last week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆283Nov 3, 2023Updated 2 years ago
- A high-performance timeline tracing library for Golang, used by TiDB☆47Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆21Updated this week
- AI-based search done right☆19Dec 25, 2025Updated 8 months ago
- 🏆 CNCF Community Awards☆27Jul 23, 2026Updated last month
- NVIDIA device plugin for Kubernetes☆15Sep 9, 2019Updated 6 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆31Mar 28, 2025Updated last year
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- Benchmark results from code generation with LLMs