tensorchord / ai-infra-statisticsLinks
This repository contains statistics about the AI Infrastructure products.
☆18Updated 5 months ago
Alternatives and similar repositories for ai-infra-statistics
Users that are interested in ai-infra-statistics are comparing it to the libraries listed below
Sorting:
- Backend server for envd☆21Updated last year
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 4 months ago
- setup the env for vllm users☆16Updated last year
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- Topling core libraries in an ark☆14Updated this week
- xet client tech, used in huggingface_hub☆148Updated this week
- OpenDAL fsspec integration☆30Updated 2 months ago
- 本插件是将faiss集成到greenplum数据库中,以提供向量召回的能力。☆22Updated 3 years ago
- ☆30Updated 3 months ago
- The driver for LMCache core to run in vLLM☆45Updated 6 months ago
- A distributed engine for elastic workload☆27Updated this week
- A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.☆24Updated last week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆270Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 3 years ago
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- InfiniBand SR-IOV CNI☆13Updated last week
- An embeddable graph database for large-scale vertices and edges☆73Updated 2 years ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆128Updated 3 weeks ago
- ☆38Updated this week
- ☆35Updated 4 years ago
- A collection of reproducible inference engine benchmarks☆32Updated 3 months ago
- Yet another coding assistant powered by LLM.☆16Updated 10 months ago
- Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台☆36Updated 3 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆148Updated 9 months ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- Turn PostgreSQL into your search engine in a Pythonic way.☆47Updated last week
- A collection of useful Go libraries for use with NVIDIA GPU management tools☆42Updated last week
- ☆17Updated 4 months ago
- DataFuse operator manages fuse-query and fuse-store clusters atop Kubernetes using CRDs.☆13Updated 3 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago