Alternatives and similar repositories for tensorlink

Users that are interested in tensorlink are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆185Updated this week
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆165Updated last week
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆161Updated this week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆110Updated this week
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆125Updated 3 years ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 10 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆265Updated last year
• 01-ai / Descartes
  ☆108Updated last year
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆33Updated last year
• HFAiLab / hai-platform-studio
  配合 HAI Platform 使用的集成化用户界面
  ☆49Updated 2 years ago
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• xorbitsai / xoscar
  Python actor framework for heterogeneous computing.
  ☆149Updated this week
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆199Updated 2 years ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆217Updated 4 months ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆205Updated 9 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 3 months ago
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆73Updated 2 weeks ago
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆103Updated 7 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆352Updated this week
• mayooot / gpu-docker-api
  Easier than K8s to lift and lower the gpu number of docker container and scale capacity size of volume.
  ☆75Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆38Updated last year
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆146Updated last year
• gvirtus / GVirtuS
  ☆49Updated 8 months ago
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated 2 years ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated 10 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆95Updated this week
• NVIDIA / vgpu-device-manager
  NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes
  ☆130Updated last week
• chaunceyjiang / fake-gpu
  This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.
  ☆44Updated 2 months ago
• mayooot / build-nccl-tests-with-pytorch
  Build NCCL-Tests and configure SSHD in PyTorch container to help you test NCCL faster!
  ☆11Updated last year