Alternatives and similar repositories for Mini_Reverse_Proxy

Users that are interested in Mini_Reverse_Proxy are comparing it to the libraries listed below

• PKUFlyingPig / Hadoop_vs_Spark
  研究生课《网络大数据管理理论和应用》大作业项目代码
  ☆13Updated 2 years ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• ccr-cheng / botzone-mahjong-environment
  Python environment for Chinese Standard Mahjong on Botzone platform.
  ☆12Updated 4 years ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆16Updated last year
• cassiewilliam / cuda_op_benchmark
  方便扩展的Cuda算子理解和优化框架，仅用在学习使用
  ☆15Updated last year
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆47Updated last year
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• ACA-Lab-SJTU / token-ring
  ☆11Updated 7 months ago
• SJTU-IPADS / disb
  DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
  ☆53Updated 11 months ago
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆15Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• casys-kaist / EnvPipe
  ☆25Updated last year
• tile-ai / tilescale
  Tile-based language built for AI computation across all scales
  ☆34Updated last week
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 8 months ago
• H-Huang / torch_collective_extension
  A minimum demo for PyTorch distributed extension functionality for collectives.
  ☆13Updated last year
• gudiandian / ElasticFlow
  ☆16Updated last year
• kazukiosawa / pipe-fisher
  ☆10Updated 2 years ago
• ruipeterpan / paper_notes
  Personal blog + reading notes on system-ish papers
  ☆15Updated last year
• pkusys / Auncel
  Vector search with bounded performance.
  ☆36Updated last year
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆46Updated 2 years ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆55Updated 9 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆42Updated 5 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆55Updated 9 months ago
• sjtu-epcc / DVABatch
  ☆20Updated 3 years ago
• ByteDance-Seed / StragglerAnalysis
  ☆38Updated 3 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆172Updated 10 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆31Updated 8 months ago