Alternatives and similar repositories for Mini_Reverse_Proxy

Users that are interested in Mini_Reverse_Proxy are comparing it to the libraries listed below

• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• cassiewilliam / cuda_op_benchmark
  方便扩展的Cuda算子理解和优化框架，仅用在学习使用
  ☆18Updated last year
• gofreelee / SpaceServe
  ☆25Updated 4 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• S-Lab-System-Group / Primo
  Primo: Practical Learning-Augmented Systems with Interpretable Models
  ☆19Updated 2 years ago
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 4 years ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆15Updated 2 years ago
• thomaschlt / mla.c
  Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.
  ☆19Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• sjtu-epcc / DVABatch
  ☆21Updated 3 years ago
• kazukiosawa / pipe-fisher
  ☆10Updated 2 years ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆56Updated last year
• dgist-datalab / deepsketch-fast2022
  ☆24Updated 3 years ago
• PKUFlyingPig / Hadoop_vs_Spark
  研究生课《网络大数据管理理论和应用》大作业项目代码
  ☆13Updated 3 years ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated 2 years ago
• wongsingfo / paper-util
  Utilities for paper writing.
  ☆12Updated last month
• H-Huang / torch_collective_extension
  A minimum demo for PyTorch distributed extension functionality for collectives.
  ☆15Updated last year
• InfiniTensor / TinyInfiniTrain
  训练营训练方向项目
  ☆27Updated 2 weeks ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆40Updated last year
• ruipeterpan / paper_notes
  Personal blog + reading notes on system-ish papers
  ☆15Updated 2 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆16Updated 6 months ago
• microsoft / FractalTensor
  FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …
  ☆32Updated last year
• hpcaitech / SkyComputing
  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
  ☆90Updated 3 years ago
• lzhangbv / acpsgd
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Updated 2 years ago
• casys-kaist / EnvPipe
  ☆26Updated 2 years ago
• TiledTensor / TiledLower
  TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated last year
• pkusys / Auncel
  Vector search with bounded performance.
  ☆35Updated 2 years ago
• qipengwang / Melon
  MobiSys#114
  ☆23Updated 2 years ago
• phonism / genesis
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆37Updated 3 weeks ago