Alternatives and similar repositories for vllm-rbln

Users that are interested in vllm-rbln are comparing it to the libraries listed below

• RBLN-SW / optimum-rbln

  View on GitHub
  ⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.
  ☆15Updated this week
• vedantroy / gpu_kernels

  View on GitHub
  ☆27Jan 8, 2024Updated 2 years ago
• RBLN-SW / rbln-model-zoo

  View on GitHub
  Example code for RBLN SDK developers building inference applications
  ☆30Updated this week
• rhubarbwu / neural-collapse

  View on GitHub
  Generic library for neural collapse and several derivative works on the phenomenon.
  ☆18Apr 14, 2025Updated 10 months ago
• efeslab / siloz

  View on GitHub
  ☆11Aug 23, 2023Updated 2 years ago
• SqueezeBits / Torch-TRTLLM

  View on GitHub
  Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.
  ☆55Jul 16, 2025Updated 6 months ago
• bentoml / diffusers-examples

  View on GitHub
  API serving for your diffusers models
  ☆11Jan 19, 2024Updated 2 years ago
• cmuparlay / psac

  View on GitHub
  Parallel Self-Adjusting Computation
  ☆15Jul 5, 2021Updated 4 years ago
• teampopong / data-for-rnd

  View on GitHub
  Korean politics data for research and development.
  ☆12Jun 21, 2016Updated 9 years ago
• mxzheng / TrojViT

  View on GitHub
  [CVPR 2023] "TrojViT: Trojan Insertion in Vision Transformers" by Mengxin Zheng, Qian Lou, Lei Jiang
  ☆14Jan 5, 2024Updated 2 years ago
• kstost / firstvibe

  View on GitHub
  ☆18Aug 27, 2025Updated 5 months ago
• csvance / jetson_tensorrt

  View on GitHub
  ROS TensorRT Inference Nodes for DIGITS on the Jetson
  ☆15Apr 6, 2019Updated 6 years ago
• Concode0 / Versor

  View on GitHub
  Versor: Stop Projecting, Start Rotating. GBN (Geometric Blade Network) - A new era of AI beyond Linear Algebra.
  ☆41Updated this week
• hao-ai-lab / cse234-w25

  View on GitHub
  Website for CSE 234, Winter 2025
  ☆13Mar 24, 2025Updated 10 months ago
• arnavdantuluri / StableTriton

  View on GitHub
  The first open source triton inference engine for Stable Diffusion, specifically for sdxl
  ☆12Nov 27, 2023Updated 2 years ago
• UbiquitousLearning / NNV12

  View on GitHub
  ☆13May 11, 2023Updated 2 years ago
• SqueezeBits / QUICK

  View on GitHub
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆120Mar 6, 2024Updated last year
• sangwoojun / ulx3s_bsv

  View on GitHub
  Bluespec environment for working with the ulx3s board and its lattice ecp5 fpga
  ☆15Mar 9, 2025Updated 11 months ago
• Embodied-VideoAgent / embodied-videoagent

  View on GitHub
  ☆41Aug 26, 2025Updated 5 months ago
• srush / Hierarchical-Bayes-Compiler

  View on GitHub
  Hal Daume's hbc
  ☆20Jan 23, 2010Updated 16 years ago
• lovit / komoran3py

  View on GitHub
  Komoran 3 in Python
  ☆11Dec 10, 2018Updated 7 years ago
• tgagor / docker-centos

  View on GitHub
  CentOS docker images, build weekly with latest security updates
  ☆11Updated this week
• haruair / gumtree-watcher

  View on GitHub
  Check the latest items from gumtree and message it
  ☆12Feb 1, 2016Updated 10 years ago
• microsoft / agents-humanoversight

  View on GitHub
  Human Oversight for Autonomous AI Agents using Azure Logic Apps + Python
  ☆20Feb 6, 2026Updated last week
• CMU-SAFARI / transpimlib

  View on GitHub
  TransPimLib is a library for transcendental (and other hard-to-calculate) functions in general-purpose PIM systems, TransPimLib provides …
  ☆15Apr 21, 2023Updated 2 years ago
• friendliai / friendli-model-optimizer

  View on GitHub
  FMO (Friendli Model Optimizer)
  ☆13Jan 8, 2025Updated last year
• xxyux / SpInfer

  View on GitHub
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆61Mar 25, 2025Updated 10 months ago
• statkclee / py4inf-kor

  View on GitHub
  Python for Informatics: Exploring Information (Korean)
  ☆29Sep 14, 2015Updated 10 years ago
• thu-ml / Jetfire-INT8Training

  View on GitHub
  ☆61Jul 21, 2024Updated last year
• bentoml / IF-multi-GPUs-demo

  View on GitHub
  ☆13Jul 5, 2023Updated 2 years ago
• RichardHightower / subagents

  View on GitHub
  Agent and Subagent example in OpenCode and ClaudeCode
  ☆35Sep 11, 2025Updated 5 months ago
• jiazhihao / attention_superoptimizer

  View on GitHub
  An Attention Superoptimizer
  ☆22Jan 20, 2025Updated last year
• wangyiqiu / pargeo

  View on GitHub
  A Collection of Parallel Algorithms for Computational Geometry
  ☆12Mar 10, 2022Updated 3 years ago
• daemyung / practice-triton

  View on GitHub
  삼각형의 실전! Triton
  ☆16Feb 15, 2024Updated last year
• bentoml / yatai-deployment

  View on GitHub
  🚀 Launching Bento in a Kubernetes cluster
  ☆17Mar 16, 2025Updated 10 months ago
• huggingface / lora-fast

  View on GitHub
  Minimal repository to demonstrate fast LoRA inference with Flux family of models.
  ☆26Jul 23, 2025Updated 6 months ago
• vbezgachev / tf_serving_cpp_client

  View on GitHub
  C++ client of a GAN model hosted by TensorFlow Serving
  ☆11Jul 31, 2018Updated 7 years ago
• Luvata / arxive

  View on GitHub
  ArXiv daily dump and viewer using GitHub Actions - luvata.github.io/arxive
  ☆14Updated this week
• lizishi / DeTRC

  View on GitHub
  ☆17Jun 9, 2024Updated last year