Alternatives and similar repositories for Decentralized-inference-based-on-vLLM

Users that are interested in Decentralized-inference-based-on-vLLM are comparing it to the libraries listed below

• ISCS-ZJU / CSWAP
  Source code for CSWAP-CLUSTER'21 and CSWAP+-TPDS'22
  ☆25Updated 3 years ago
• ISCS-ZJU / PHAST
  Source code for PHAST-TPDS'22
  ☆29Updated last year
• ISCS-ZJU / PMAlloc
  ☆27Updated 3 months ago
• ISCS-ZJU / Frenzy
  ☆31Updated 3 months ago
• ISCS-ZJU / XPGraph
  Source code for XPGraph-MICRO'22
  ☆26Updated 3 years ago
• ISCS-ZJU / AdaMBE
  Source code for AdaMBE-SC'24
  ☆25Updated last year
• ISCS-ZJU / GMBE
  Source code for GMBE-SC'23
  ☆35Updated 2 years ago
• ISCS-ZJU / LeapGNN-AE
  ☆39Updated 6 months ago
• ISCS-ZJU / AMBEA
  Source code for AMBEA-TC'24
  ☆29Updated last year
• ISCS-ZJU / ChunkGraph
  Source code for ChunkGraph-ATC'24
  ☆28Updated last year
• ISCS-ZJU / CCL-BTree
  Source code for CCLBTree-EuroSys'24
  ☆42Updated last year
• ISCS-ZJU / PyTorch-LLM-Support
  Appling the asynchronous tensor swapping to PyTorch framework.
  ☆30Updated 2 years ago
• ISCS-ZJU / Zplot-demo
  Zplot demos
  ☆21Updated 3 years ago
• ISCS-ZJU / NVAlloc
  Source code for NVAlloc-ASPLOS'22
  ☆59Updated 3 years ago
• ISCS-ZJU / iCache
  Source code for iCache-HPCA'23
  ☆49Updated 2 years ago
• tawnysky / PLIN
  A persistent learned index for non-volatile memory with high read/write performance.
  ☆18Updated 3 years ago
• LighT-chenml / GPHash
  ☆9Updated 7 months ago
• thustorage / osdi21ae
  Nap - NUMA-Aware Persistent Indexes
  ☆41Updated 4 years ago
• dmemsys / awesome-disaggregated-memory
  A collection of awesome researchers and papers about disaggregated memory.
  ☆163Updated last month
• dmemsys / Ditto
  This is the implementation repository of our SOSP'23 paper: Ditto: An Elastic and Adaptive Memory-Disaggregated Caching System.
  ☆36Updated last year
• thustorage / Frugal
  for paper @ ASPLOS‘25’
  ☆16Updated 4 months ago
• thustorage / PipeANN
  A low-latency, billion-scale, and updatable graph-based vector store on SSD.
  ☆54Updated last week
• astlxmu / LearnedFTL
  ☆18Updated 10 months ago
• pkusys / Rummy
  GPU-accelerated vector query processing system that supports large vector datasets beyond GPU memory.
  ☆29Updated last year
• wonglkd / Baleen-FAST24
  Code for "Baleen: ML Admission & Prefetching for Flash Caches" (FAST 2024).
  ☆26Updated last year
• optiq-lab / 3L-Cache
  ☆10Updated 6 months ago
• spypaul / MQSim_CXL
  ☆72Updated 2 years ago
• olemon111 / WIPE
  WIPE implementation
  ☆11Updated last year
• cuhk-mass / SEPH
  ☆18Updated 2 years ago
• platformxlab / LeaFTL
  ☆20Updated 2 years ago