Alternatives and similar repositories for Mini_Reverse_Proxy:

Users that are interested in Mini_Reverse_Proxy are comparing it to the libraries listed below

• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated 8 months ago
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆53Updated this week
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆19Updated this week
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆15Updated 2 months ago
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 2 years ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆43Updated this week
• flashinfer-ai / debug-print
  Debug print operator for cudagraph debugging
  ☆10Updated 6 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆24Updated 2 months ago
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆38Updated 9 months ago
• abcdabcd987 / libfabric-efa-demo
  ☆25Updated last month
• microsoft / FractalTensor
  ☆23Updated last month
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated last year
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆38Updated 6 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• casper-hansen / AutoAWQ_kernels
  ☆64Updated 2 months ago
• lcy-seso / DLFrameworkTest
  My tests and experiments with some popular dl frameworks.
  ☆11Updated this week
• chhzh123 / ptc-tutorial
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆19Updated last year
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆55Updated last month
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 4 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆34Updated 3 months ago
• mlc-ai / mlc-python
  ☆21Updated this week
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆51Updated last week
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆34Updated 2 months ago