Alternatives and similar repositories for tensorlink:

Users that are interested in tensorlink are comparing it to the libraries listed below

• tenclass / clink
  Implementation of remote CUDA/OpenCL protocol
  ☆32Updated 8 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆101Updated this week
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆278Updated this week
• RWTH-ACS / cricket
  cricket is a virtualization solution for GPUs
  ☆181Updated this week
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆122Updated 2 years ago
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆196Updated 2 years ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆251Updated last year
• VQLite / VQLite
  VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN
  ☆88Updated 7 months ago
• 01-ai / Descartes
  ☆107Updated 10 months ago
• Project-HAMi / HAMi-core
  HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container
  ☆132Updated this week
• NVIDIA / vgpu-device-manager
  NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes
  ☆126Updated last week
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆20Updated 2 months ago
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆71Updated this week
• mayooot / gpu-docker-api
  Easier than K8s to lift and lower the gpu number of docker container and scale capacity size of volume.
  ☆72Updated 10 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆62Updated 10 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service.
  ☆122Updated last week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆40Updated last week
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆60Updated this week
• NVIDIA / go-dcgm
  Golang bindings for Nvidia Datacenter GPU Manager (DCGM)
  ☆103Updated 2 weeks ago
• lessapi-dev / lessapi-duckduckgo
  LessAPI-DuckDuckGo is an API service for a search engine. Simple, lightweight, reliable, Docker deployable, easy to maintain. 一个基于DuckDuc…
  ☆45Updated 9 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆79Updated this week
• data-accelerator / dadi-p2proxy
  HTTP based Tree-shaped Peer2Peer blob transfer proxy, distributing images or blob data.
  ☆20Updated 2 years ago
• labring / sealfs
  The storage system of sealos, aims to be a high-performance, high-reliability, and auto-scaling distributed file system
  ☆146Updated last year
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆99Updated 5 months ago
• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆264Updated 11 months ago
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆577Updated 2 months ago
• volcengine / volcengine-go-sdk
  ☆61Updated this week
• Bruce-Lee-LY / cuda_hook
  Hooked CUDA-related dynamic libraries by using automated code generation tools.
  ☆145Updated last year
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆145Updated 11 months ago
• virtaitech / orion
  ☆273Updated last year