Alternatives and similar repositories for tensorlink

Users that are interested in tensorlink are comparing it to the libraries listed below

• tenclass / clink
  Implementation of remote CUDA/OpenCL protocol
  ☆36Updated last month
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆226Updated this week
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆177Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆269Updated last year
• seasonjs / rwkv
  pure go for rwkv
  ☆19Updated last year
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆125Updated 3 years ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆209Updated 10 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆44Updated last week
• kubegems / modelx
  A simple, High-Performance, Scalable ML/DL Models Repository based on OCI Artifacts
  ☆33Updated last year
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆201Updated 2 years ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆67Updated last year
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆421Updated 11 months ago
• xorbitsai / xoscar
  Python actor framework for heterogeneous computing.
  ☆152Updated this week
• matpool / mpu
  A shim driver allows in-docker nvidia-smi showing correct process list without modify anything
  ☆87Updated 3 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆377Updated this week
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated last year
• soulteary / dify-go-sdk
  Golang SDK for langgenius/dify .
  ☆29Updated last year
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆129Updated 2 weeks ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆49Updated 11 months ago
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆91Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆236Updated 3 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 3 months ago
• sugarforever / peanut-shell
  ☆53Updated 6 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆310Updated last week
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆595Updated 6 months ago
• jack139 / go-infer
  Go framework for DL model inference and API deployment
  ☆49Updated 6 months ago
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆209Updated this week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆105Updated 9 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆154Updated 11 months ago