tensorchord / ai-infra-statisticsLinks
This repository contains statistics about the AI Infrastructure products.
☆18Updated 4 months ago
Alternatives and similar repositories for ai-infra-statistics
Users that are interested in ai-infra-statistics are comparing it to the libraries listed below
Sorting:
- Backend server for envd☆21Updated last year
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆28Updated 3 months ago
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- ☆11Updated 5 years ago
- Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台☆36Updated 3 years ago
- setup the env for vllm users☆16Updated last year
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.☆11Updated 3 years ago
- Paper Reading：涉及分布式、虚拟化、网络、机器学习☆23Updated 4 years ago
- clustering algorithm implementation☆13Updated this week
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- xet client tech, used in huggingface_hub☆124Updated this week
- Topling core libraries in an ark☆14Updated 8 months ago
- Elastic cache solution on Kubernetes☆10Updated 4 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- ☆17Updated 4 months ago
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆156Updated this week
- OpenDAL fsspec integration☆30Updated last month
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Updated this week
- Feasibility research for using kind to support e2e tests for kubebuilder(v2)-generated Kubernetes operators.☆13Updated 6 years ago
- A distributed engine for intelligent workload☆26Updated 5 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆147Updated 8 months ago
- ☆29Updated 2 months ago
- 本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。☆22Updated 2 years ago
- The scheduler of Volcano, built based on kubernetes-sigs/kube-batch☆14Updated 6 years ago
- 🏆 The winner code for Neurips'23 BigANN Competition OOD and Sparse track.☆12Updated 3 weeks ago
- 完成6/7，有半成品文档(文档留有大量TODO)☆12Updated 7 years ago
- Lightning In-Memory Object Store☆47Updated 3 years ago