tensorchord / ai-infra-statisticsLinks
This repository contains statistics about the AI Infrastructure products.
☆17Updated 11 months ago
Alternatives and similar repositories for ai-infra-statistics
Users that are interested in ai-infra-statistics are comparing it to the libraries listed below
Sorting:
- Backend server for envd☆22Updated 2 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 10 months ago
- Deploy ChatGLM on Modelz☆16Updated 2 years ago
- A distributed system for Agentic AI☆43Updated this week
- setup the env for vllm users☆16Updated 2 years ago
- OpenDAL fsspec integration☆33Updated 2 weeks ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- clustering algorithm implementation☆13Updated 3 months ago
- An embeddable graph database for large-scale vertices and edges☆74Updated 2 years ago
- ☆31Updated 9 months ago
- Topling core libraries in an ark☆17Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆279Updated 2 years ago
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆59Updated last month
- Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台☆36Updated 4 years ago
- Feasibility research for using kind to support e2e tests for kubebuilder(v2)-generated Kubernetes operators.☆13Updated 6 years ago
- Paper Reading：涉及分布式、虚拟化、网络、机器学习☆23Updated 5 years ago
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 4 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 5 years ago
- InfiniBand SR-IOV CNI☆13Updated last month
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Updated 9 months ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- ☆17Updated 4 months ago
- SJTU SE3357 操作系统笔记 OS Notes☆19Updated 2 years ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆151Updated last year
- How query engine work golang port for learning purpose☆23Updated 4 years ago
- A time series database prototype with multiple backends☆23Updated 5 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 6 years ago
- A collection of useful Go libraries for use with NVIDIA GPU management tools☆50Updated 2 weeks ago
- engula-operator creates/configures/manages engula clusters atop Kubernetes☆11Updated 4 years ago