tensorchord / ai-infra-statisticsLinks
This repository contains statistics about the AI Infrastructure products.
☆18Updated 3 months ago
Alternatives and similar repositories for ai-infra-statistics
Users that are interested in ai-infra-statistics are comparing it to the libraries listed below
Sorting:
- Backend server for envd☆20Updated last year
- Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.☆11Updated 3 years ago
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 2 months ago
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago
- Topling core libraries in an ark☆14Updated 7 months ago
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆32Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- A distributed engine for intelligent workload☆26Updated 3 months ago
- ☆11Updated 4 years ago
- A collection of reproducible inference engine benchmarks☆31Updated last month
- ☆17Updated 2 months ago
- The driver for LMCache core to run in vLLM☆39Updated 3 months ago
- Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台☆36Updated 3 years ago
- ☆9Updated last year
- ☆26Updated last month
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- Distributed KV cache coordinator☆31Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated 5 months ago
- setup the env for vllm users☆16Updated last year
- 🏆 The winner code for Neurips'23 BigANN Competition OOD and Sparse track.☆10Updated 3 weeks ago
- clustering algorithm implementation☆13Updated 3 weeks ago
- ☆19Updated last year
- OpenAI compatible API for open source LLMs☆15Updated last year
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆17Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- Feasibility research for using kind to support e2e tests for kubebuilder(v2)-generated Kubernetes operators.☆13Updated 5 years ago
- CCGRID 2019: MXNet-G is a deep learning framework designed based on MXNet. It allows you to train models with a novel distributed SGD (St…☆10Updated 6 years ago
- Workflow Defined Engine☆24Updated last month