Alternatives and similar repositories for vllm-CachedAttention

Users that are interested in vllm-CachedAttention are comparing it to the libraries listed below

• eddiegaoo / Apt-Serve

  View on GitHub
  ☆20Jun 9, 2025Updated 8 months ago
• cake-lab / perseus

  View on GitHub
  ☆10Jul 5, 2023Updated 2 years ago
• stanford-futuredata / cs245-as2-public

  View on GitHub
  ☆11Jan 26, 2022Updated 4 years ago
• cornell-brg / torng-uecgra-scripts-hpca2021

  View on GitHub
  ☆11Aug 4, 2022Updated 3 years ago
• masoud-ata / ToMasulator

  View on GitHub
  A Tomasulo & Scoreboarding Visual Simulator
  ☆10Nov 19, 2023Updated 2 years ago
• hegongshan / Storage-for-AI-Paper

  View on GitHub
  Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
  ☆57Dec 17, 2025Updated 2 months ago
• vbdi / epdserve

  View on GitHub
  [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation
  ☆22May 29, 2025Updated 8 months ago
• luzhixing12345 / klinux

  View on GitHub
  linux 内核技术文档
  ☆16Jan 12, 2026Updated last month
• Avanti1980 / course-alg

  View on GitHub
  ☆10Jan 4, 2026Updated last month
• arcsysu / SYSU-ARCH

  View on GitHub
  SYSU-ARCH is a LAB that focuses on the use and extending of simulators.
  ☆10Dec 19, 2022Updated 3 years ago
• Unknown-Body / Graph-Neural-Network

  View on GitHub
  All materials related to GNN
  ☆14Jan 4, 2023Updated 3 years ago
• joaomiguelvieira / gem5-accel

  View on GitHub
  ☆16Sep 15, 2023Updated 2 years ago
• RC4ML / CAM

  View on GitHub
  CAM: Asynchronous GPU-Initiated, CPU-Managed SSD Management for Batching Storage Access [ICDE'25]
  ☆18Mar 3, 2025Updated 11 months ago
• Adaxry / Unified_Layer_Skipping

  View on GitHub
  ☆15Apr 11, 2024Updated last year
• CLab-HKUST-GZ / micro58-axcore

  View on GitHub
  ☆30Oct 21, 2025Updated 3 months ago
• fengChenHPC / kmeans_cuda

  View on GitHub
  A high performance implementation of kmeans algorithm with cuda
  ☆18Sep 7, 2014Updated 11 years ago
• stonet-research / cheops25-IO-characterization-of-LLM-model-kv-cache-offloading-nvme

  View on GitHub
  ☆15Apr 15, 2025Updated 10 months ago
• LeonLee666 / DBstack

  View on GitHub
  ☆12Mar 5, 2025Updated 11 months ago
• FateWuLov / HUST-OS-PKE

  View on GitHub
  华中科技大学2020级操作系统课设
  ☆12Apr 2, 2023Updated 2 years ago
• Carrefour / carrefour-module

  View on GitHub
  This module collects per-page stats and decide for each page if it should be migrated, replicated or interleaved.
  ☆16Sep 29, 2015Updated 10 years ago
• cxlbench / cxlbench

  View on GitHub
  A Compute Express Link (CXL) Benchmark Suite
  ☆20Feb 12, 2025Updated last year
• NativeAIInfra / awesome-ai-infra

  View on GitHub
  introduce AI infra knowledges. 人工智能系统基础架构知识库
  ☆16Jun 4, 2023Updated 2 years ago
• PrincetonUniversity / Duet

  View on GitHub
  ☆14Feb 28, 2023Updated 2 years ago
• rssys / snowcat

  View on GitHub
  This repository contains the artifact for the SOSP'23 paper: Sishuai Gong, Dinglan Peng, Deniz Altınbüken, Pedro Fonseca, Petros Maniati…
  ☆15Oct 24, 2023Updated 2 years ago
• cohort-project / cohort-soc

  View on GitHub
  Cohort Project
  ☆19Oct 23, 2025Updated 3 months ago
• harvard-edge / Gables

  View on GitHub
  ☆15Apr 3, 2020Updated 5 years ago
• xhd2015 / rsp3-armv8-baremetal-tutorial

  View on GitHub
  基于树莓派3构建一个操作系统的系列教程
  ☆13Jun 19, 2018Updated 7 years ago
• abskl / GPT-Academic

  View on GitHub
  为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型…
  ☆14Feb 18, 2024Updated last year
• microideax / T-DLA

  View on GitHub
  ☆19Dec 3, 2019Updated 6 years ago
• pmem / pmem.github.io

  View on GitHub
  The pmem.io Website
  ☆17Jan 20, 2026Updated 3 weeks ago
• ROCm / rocBLAS-Examples

  View on GitHub
  Examples illustrating usage of the rocBLAS library
  ☆17Aug 12, 2024Updated last year
• MashPlant / rpi-image-locating

  View on GitHub
  THU Embedded System course project.
  ☆15Dec 18, 2020Updated 5 years ago
• fly-lovest / HUST-CS-Compilation-Principle

  View on GitHub
  HUST-CS-2019 编译原理课程及其实验内容
  ☆15Oct 25, 2022Updated 3 years ago
• oscomp / proj47-tee-os

  View on GitHub
  面向可信执行环境的OS。
  ☆12May 9, 2025Updated 9 months ago
• Scientific-Computing-Lab / STREAMer

  View on GitHub
  STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth
  ☆17Aug 21, 2023Updated 2 years ago
• scalesim-project / krittika

  View on GitHub
  Heterogenous ML accelerator
  ☆20May 5, 2025Updated 9 months ago
• compiler-disagg / TrackFM

  View on GitHub
  A compiler to automatically transform applications into disaggregated memory apps.
  ☆16Nov 16, 2023Updated 2 years ago
• IObundle / iob-versat

  View on GitHub
  Coarse Grained Reconfigurable Array
  ☆20Dec 17, 2025Updated 2 months ago
• jack-willturner / nas-as-program-transformation-exploration

  View on GitHub
  The code for our paper "Neural Architecture Search as Program Transformation Exploration"
  ☆16Apr 28, 2021Updated 4 years ago